Changing multiprocess "wait unlimited seconds" timeout?

[Ian Crew]

Hi all:

Is there any way to change the "wait unlimited seconds" timeout used with the "multiprocess" option?

Here's why I'm asking:

We're running the following command via cron:

gam config auto_batch_min 1 num_threads 25 batch_size 100 redirect csv - multiprocess ous_and_children "/Users/OverQuota" print drivesettings usage

Sometimes--for several hours once or twice a month--it seems that Google's APIs "glitch" (technical term!) and some of the sub-processes get stuck or never return. Most recently, this happened on December 10th and December 31/January 1 (but it's not happening today).

And that means that we get a bunch of cron jobs stacked up that never exit.

It seems to me that if we could change "wait unlimited seconds" to something like "wait 600 seconds", that'd fix things nicely. But I don't see anything on https://github.com/taers232c/GAMADV-XTD3/wiki/Bulk-Processing that would indicate that we could do something like that.

Is this possible?

If it makes a difference, we're running GAMADV-XTD3 6.80.18 (and yes, I know that's a little old).

Thanks!

Ian

--

Ian Crew

Architect, Communication and Collaboration Services
Productivity & Collaboration Services
Berkeley IT

University of California, Berkeley

[Ross Scroggs]

process_wait_limit                                                                                                                                                                                                                               

        When processing batch/CSV files, how long (in seconds) GAM should wait for all batch|csv processes to complete                                                                                                                           

        after all have been started. If the limit is reached, GAM terminates any remaining processes.                                                                                                                                            

        Default: 0: no limit                                                                                                                                                                                                                     

        Range: 0 - Unlimited                                                                                                                                                                                                                     

gam config auto_batch_min 1 num_threads 25 batch_size 100 process_wait_limit 600 redirect csv - multiprocess ous_and_children "/Users/OverQuota" print drivesettings usage

Ross

----

Ross Scroggs

Ross.S...@gmail.com

--
You received this message because you are subscribed to the Google Groups "GAM for Google Workspace" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-apps-man...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/CAD2sLFv6eZBepxx9pRL7FwE0yU9J72mfRHpJuh2BfqC3%3DXbcQw%40mail.gmail.com.

[Ian Crew]

Perfect, thanks Ross! Just what I needed.

Cheers,

Ian

--

Ian Crew

Architect, Communication and Collaboration Services
Productivity & Collaboration Services
Berkeley IT

University of California, Berkeley

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/6D39AC07-D2AA-4A96-B232-F8DFC2406681%40gmail.com.

[Fadhli F]

Hi,

I am using the method above as well to terminate "wait unlimited seconds", can I check if the gam command is actually completed by adding "process_wait_limit 600"?

this is my command for your reference :

gam config auto_batch_min 1 num_threads 25 batch_size 100 process_wait_limit 600 redirect csv output.csv multiprocess redirect stdout - multiprocess redirect stderr stdout test.csv gam user ~emailaddress move drivefile root teamdriveparentid ~folderid mergewithparent

[Fadhli F]

because this is what I see in the last output: 

2025-01-16T13:29:36.296+00:00,0/118,Waiting for 6 running processes to finish before terminating, wait limit 5 seconds
2025-01-16T13:29:41.297+00:00,0/118,Terminating 6 running processes

[Ross Scroggs]

You commands can take a very long time to complete.

Delete this from the command: 

process_wait_limit 600

Ross

----

Ross Scroggs

Ross.S...@gmail.com

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/49f65b75-2a44-4ddb-a80e-b9008af13f72n%40googlegroups.com.

[Fadhli F]

Yes, but it seems it takes more than 12 hours without "process_wait_limit 600" and it keeps on this "Waiting for 6 running processes to finish before terminating" for several hours.

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/7D6D3A04-BF76-4A2D-A258-34F164A3B721%40gmail.com.