Daily GAM API Error Causing Org Checker Run to Terminate

[Ashmitha Anand]

Hi GAM Support Team,

We are experiencing a recurring API error in Google Ad Manager (GAM) on a daily basis, which is causing our Org Checker process to terminate unexpectedly.

Our sync cycle runs every six hours, at approximately 6:00 AM, 12:00 PM, 6:00 PM, and 12:00 AM EST.

Below are the duration logs from August 10, 2026:

2026-08-10 02:44:00: Sync had a duration of 2.73 hours.
2026-08-10 03:13:15: Group mirroring had a duration of 0.48 hours.
2026-08-10 08:52:09: Sync had a duration of 2.86 hours.
2026-08-10 09:21:21: Group mirroring had a duration of 0.48 hours.
2026-08-10 11:30:28: Org checker had a duration of 2.15 hours.
2026-08-10 14:41:52: Sync had a duration of 2.69 hours.
2026-08-10 15:11:21: Group mirroring had a duration of 0.49 hours.
2026-08-10 17:15:24: Org checker had a duration of 2.06 hours.
2026-08-10 20:34:13: Sync had a duration of 2.56 hours.
2026-08-10 21:01:08: Group mirroring had a duration of 0.44 hours.
2026-08-10 22:52:34: Org checker had a duration of 1.85 hours.

Based on the schedule, we would expect at least 12 total runs in the cycle, with three runs each for Sync, Group Mirroring, and Org Checker. However, the Org Checker was terminated during the first cycle, which resulted in fewer expected runs.

The error occurs during the Org Checker process. The relevant log is:

Starting org checker run.

2026-08-10 03:18:28: All Google user data has been pulled: 127354 users total.
2026-08-10 03:23:04: All Google user alias data has been pulled: 262685 aliases in total.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed three times. Stopping org check.

This appears to happen consistently on a daily basis.

Could you please help us determine:

1. Why the GAM API query for print license maxresults 100 product 1010020020 is failing?
2. Whether there are any API quota, rate-limit, authentication, or permission-related issues associated with this request?
3. Whether there have been any recent changes to the GAM API that could be causing this behavior?
4. Whether the query syntax or the product 1010020020 parameter is still supported?
5. What we should change on our side to prevent the Org Checker from being terminated?

Could you also please check the API request failures on your end around the timestamp 2026-08-10 03:23:04 and let us know if you can identify the specific error being returned by GAM?

Since this is occurring daily and is affecting the completion of our scheduled Org Checker runs, we would appreciate your assistance in identifying the root cause.

Please let us know if you need any additional logs or other information from our side.

Thank you,
Ashmitha

[Jay Lee]

Hi Ashmitha,

  This forum is for GAM for Google Workspace, not Google Ad Manager. Apologies for the confusion caused by the identical acronyms. You might try reporting your issue to the Ad Manager community forum:

https://support.google.com/admanager/community?hl=en

Jay Lee

--
You received this message because you are subscribed to the Google Groups "GAM for Google Workspace" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-apps-man...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/d2f11f21-95c7-483f-80a0-3d48ae4a4782n%40googlegroups.com.

[Danny Dillon - NOAA Affiliate]

We have been seeing the issue below  using GAM 7.39.02 since Jul 11 on a different SKU (Voice).  

We were waiting to upgrade GAM before reporting this, as the voice data was purely informational.

Seeing this ticket, which appears to use GAManager syntax below, prompted me to mention our issue.

1. Why the GAM API query for print license maxresults 100 product 1010020020 is failing?

We use the same core GAM syntax for 3 licenses. 

For us:

1010020020 (Google Workspace Enterprise Plus) is working

1010340001 (Google Workspace Enterprise Plus - Archived User) is working

1010330002 (Google Voice Premier) has been failing since July 11

The following command ( with different output ) worked daily with previous versions since the voice sku was supported.

$ gam config debug_level 2 redirect stderr stdout print license maxresults 100 product 101033

connect: (licensing.googleapis.com, 443)

send: GET /$discovery/rest?version=v1 HTTP/1.1
          Host: licensing.googleapis.com
          content-length: 0
          user-agent: GAM 7.39.02 - https://github.com/GAM-team/GAM / GAM Team <google-ap...@googlegroups.com> / Python 3.14.3 final / Linux-4.18.0-553.151.1.el8_10.x86_64-x86_64-with-glibc2.35 x86_64 /
          x-goog-api-client: cred-type/u
          authorization: Bearer *****
          accept-encoding: gzip, deflate

reply: 'HTTP/1.1 200 OK\r\n'
header: Content-Type: application/json; charset=UTF-8
header: Vary: Origin
header: Vary: X-Origin
header: Vary: Referer
header: Content-Encoding: gzip
header: Date: Tue, 11 Aug 2026 13:34:02 GMT
header: Server: ESF
header: X-XSS-Protection: 0
header: X-Frame-Options: SAMEORIGIN
header: X-Content-Type-Options: nosniff
header: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
header: Transfer-Encoding: chunked
send: GET /apps/licensing/v1/product/101033/users?customerId=C046zun9c&maxResults=100&fields=nextPageToken%2Citems%28userId%2CproductId%2CskuId

reply: 'HTTP/1.1 503 Service Unavailable\r\n'
header: Vary: Origin
header: Vary: X-Origin
header: Vary: Referer
header: Content-Type: application/json; charset=UTF-8
header: Content-Encoding: gzip
header: Date: Tue, 11 Aug 2026 13:34:02 GMT
header: Server: ESF
header: X-XSS-Protection: 0
header: X-Frame-Options: SAMEORIGIN
header: X-Content-Type-Options: nosniff
header: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
header: Transfer-Encoding: chunked
ERROR:  JSON: {'error': {'code': 503, 'message': 'Backend Error', 'errors': [{'message': 'Backend Error', 'domain': 'global', 'reason': 'backendError'}]}}

repeated 2x
send: GET /apps/licensing/v1/product/101033/users?customerId=C046zun9c&maxResults=100&fields=nextPageToken%2Citems%28userId%2CproductId%2CskuId
reply: 'HTTP/1.1 503 Service Unavailable\r\n'
ERROR:  JSON: {'error': {'code': 503, 'message': 'Backend Error', 'errors': [{'message': 'Backend Error', 'domain': 'global', 'reason': 'backendError'}]}}

more repeats
Temporary error: backendError - Backend Error, Backing off: 16 seconds, Retry: 4/10
Temporary error: backendError - Backend Error, Backing off: 32 seconds, Retry: 5/10
Temporary error: backendError - Backend Error, Backing off: 60 seconds, Retry: 6/10
Temporary error: backendError - Backend Error, Backing off: 60 seconds, Retry: 7/10
Temporary error: backendError - Backend Error, Backing off: 60 seconds, Retry: 8/10
Temporary error: backendError - Backend Error, Backing off: 60 seconds, Retry: 9/10

final
send: GET /apps/licensing/v1/product/101033/users?customerId=C046zun9c&maxResults=100&fields=nextPageToken%2Citems%28userId%2CproductId%2CskuId
ERROR:  JSON: {'error': {'code': 503, 'message': 'Backend Error', 'errors': [{'message': 'Backend Error', 'domain': 'global', 'reason': 'backendError'}]}}
ERROR: 503: backendError - Backend Error

Thanks,

Danny

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/CA%2BVVBp_R3wLPcN4DEk03sUFbSSL0FqsK_ZR07URDwBQh95%3DuMw%40mail.gmail.com.

[Ashmitha Anand]

Hi Jay Lee sorry for my typo in the email but the issue we are facing is for GAM for Google Workspace. Can you please help
Basically  This appears to happen consistently on a daily basis.

2026-08-10 03:18:28: All Google user data has been pulled: 127354 users total.
2026-08-10 03:23:04: All Google user alias data has been pulled: 262685 aliases in total.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.
2026-08-10 03:23:04: Query to Google for "print license maxresults 100 product 1010020020" has failed three times. Stopping org check.

[Ashmitha Anand]

Hi thanks for the response.

Does that mean according to your insight if Gam version upgrades this would resolve ?

[Jay Lee]

That's not GAM outputting those logs, it's whatever app or script you have calling GAM.

It's not telling us the exact GAM command you are running or the exact error it is getting. To help you we'll need those. 

Jay

Jay Lee

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/e444451b-78a3-4413-bb4f-3482731ebb42n%40googlegroups.com.

[Danny Dillon - NOAA Affiliate]

We have had other priorities imposed lately, so I won't be able to upgrade until next week. I just jumped in because I was pretty sure of your typo.

It is simply a personal preference to update and use the latest version before opening tickets when possible.  It would probably help if you provided your version and perhaps debug info to the thread.

Upgrading might resolve the issue, but since it's still working for other SKUs, it could simply be the Google backend as GAM is reporting.

Thanks,

Danny

To view this discussion visit https://groups.google.com/d/msgid/google-apps-manager/3182422e-ba10-45a8-aa07-7377db606be7n%40googlegroups.com.

[Ashmitha Anand]

Hi Danny,

We upgraded to version 7.47.04. For the first two days, the sync cycle worked completely fine without any errors. However, for the past three days, one of the sync cycles has started failing again with the following error:

Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.

Could you please help us investigate what might be causing this issue?

Since the logs and script contain company data, we’re not permitted to share the complete script or logs unfortunately

[Ashmitha Anand]

Hi Jay  

Basically Our sync cycle runs every six hours, at approximately 6:00 AM, 12:00 PM, 6:00 PM, and 12:00 AM EST.

gam print users or aliases doesnt run everytime and fails atleast once due to API. 

[Ashmitha Anand]

The error we are seeing is:

Query to Google for "print license maxresults 100 product 1010020020" has failed. Trying again.

The GAM command being executed is:

gamcall licenses "print license maxresults 100 product 1010020020"

This command was originally introduced as a workaround because gam print licenses had failed previously. The workaround was to limit the results to 100 and specify the product ID1010020020.

The issue is intermittent — the sync works successfully in some cycles, but one cycle has been failing consistently