Internal error when asking for product_group_view stats for listing_group.type UNIT

[Konstantin Tarassow]

Hello,

since 2024-01-10 multiple accounts of our clients stopped delivering data via API.

When debugging we could pinpoint the problem to the following query:

SELECT segments.date campaign.id ad_group.id ad_group_criterion.criterion_id, ad_group_criterion.criterion_id, segments.ad_network_type, segments.device, metrics.cost_micros, metrics.clicks, metrics.impressions, metrics.impressions                     FROM product_group_view                    WHERE segments.date BETWEEN '2024-01-10' AND '2024-01-15'                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)                     AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)                    AND ad_group_criterion.listing_group.type = 'UNIT'                  AND metrics.impressions > 0  AND segments.date = '2024-01-10'

Here is an example request, response with Ids, query log etc.

-------
Method Name: /google.ads.googleads.v14.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",
    "x-goog-request-params": "customer_id=6122809176",
    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:
{"customerId":"6122809176","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nad_group_criterion.criterion_id,\nad_group_criterion.criterion_id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.impressions,\nmetrics.impressions\n                    FROM product_group_view\n                    WHERE segments.date BETWEEN '2024-01-10' AND '2024-01-15'\n                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.listing_group.type = 'UNIT'\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-10' "}

Response
-------
Headers: {
    "request-id": "e31ZJDPF02Xfo145qZnyaA",
    "date": "Tue, 16 Jan 2024 21:56:59 GMT",
    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------
Status code: 13
Details: Internal error encountered.
Failure: {"errors":[{"errorCode":{"internalError":"INTERNAL_ERROR"},"message":"An internal error has occurred."}],"requestId":"e31ZJDPF02Xfo145qZnyaA"}

[Google Ads API Forum Advisor]

Hi,

Thank you for reaching out to the Google Ads API support team.

After reviewing your concern, I understand that you are encountering the "INTERNAL_ERROR" when pulling data from the product_group_view resource.

Kindly note that INTERNAL_ERROR occurs when something unexpected happens while processing the request. You can retry any requests that failed with this error using an exponential backoff schedule for the retries.

If you are still getting the same errors even after retrying, kindly provide us with the latest complete API logs (request and response with request-id and request header) generated at your end.

If you are using a client library and haven't enabled logging yet, I would request that you enable logging for the specific client library that you are using. You can refer to the guides Java, .Net, PHP, Python, Ruby or Perl to enable logging at your end. For REST interface requests, you can enable logging via the curl command by using the -i flag.

You can send the details via the Reply privately to the author option or a direct private reply to this email. 

This message is in relation to case "ref:!00D1U01174p.!5004Q02rX0D4:ref"

Thanks,
 

Google Ads API Team

[Konstantin Tarassow]

Hello, I sent you details in a private reply. We are already doing automatic retries with back-off etc. We are consistently running into an Internal Error with such queries for a week already.

[Google Ads API Forum Advisor]

Hi,

Thank you for getting back to us.

I will check with our team regarding your issue, and one of my team members will reach out to you once we have an update on this. Meanwhile, your patience is highly appreciated. 

[Konstantin Tarassow]

Hi,

just wanted to ask what the current status on this is.

In the meantime, client 6122809176 seems to be working again, now we 'only' have 3 more accounts which run into Internal Error.

7041860131
6600753004
8875125139

Whatever you did to 6122809176, can you please do the same for those 3 too?

Thanks!

[Google Ads API Forum Advisor]

Konstanin:

There was a mitigation applied on the back end late on 25 January. I would have expected it to work for all of the CIDs. Let investigate the three that you have referenced and get back to you.

What was the date and time of the last INTERNAL ERROR?

 

This message is in relation to case "ref:!00D1U01174p.!5004Q02rX0D4:ref"

Thanks,
 

Bob Hancock Google Ads API Team

 

[Konstantin Tarassow]

Just ran a fresh retry:

7041860131

Internal error

"request-id": "xxrYqrzE2RMHu_a38pPBrg", "date": "Mon, 29 Jan 2024 16:03:25 GMT",

Method Name: /google.ads.googleads.v14.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",

    "x-goog-request-params": "customer_id=7041860131",

    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:

{"customerId":"7041860131","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nad_group_criterion.criterion_id,\nad_group_criterion.criterion_id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.impressions,\nmetrics.impressions\n                    FROM product_group_view\n                    WHERE segments.date BETWEEN '2024-01-01' AND '2024-01-28'\n                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.listing_group.type = 'UNIT'\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-01' "}

Response
-------
Headers: {
    "request-id": "xxrYqrzE2RMHu_a38pPBrg",
    "date": "Mon, 29 Jan 2024 16:03:25 GMT",

    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------
Status code: 13
Details: Internal error encountered.

8875125139

Internal error

"request-id": "EzraB_Av0WPkHCX6pw3_BQ", "date": "Mon, 29 Jan 2024 15:58:17 GMT",

Method Name: /google.ads.googleads.v14.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",

    "x-goog-request-params": "customer_id=8875125139",

    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:

{"customerId":"8875125139","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nad_group_criterion.criterion_id,\nad_group_criterion.criterion_id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.impressions,\nmetrics.impressions\n                    FROM product_group_view\n                    WHERE segments.date BETWEEN '2024-01-01' AND '2024-01-28'\n                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.listing_group.type = 'UNIT'\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-01' "}

Response
-------
Headers: {
    "request-id": "EzraB_Av0WPkHCX6pw3_BQ",
    "date": "Mon, 29 Jan 2024 15:58:17 GMT",

    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------
Status code: 13
Details: Internal error encountered.

The third one is interesting, it now says that the account is deactivated, which is not true,

we verify specifically with the customer, he says he did not touch it in any way.

6600753004

The customer account can't be accessed because it is not yet enabled or has been deactivated.

 "request-id": "V_kDYTHeL-URYkJeImoEyQ", "Mon, 29 Jan 2024 15:57:14 GMT",

Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",

    "x-goog-request-params": "customer_id=6600753004",

    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:

{"customerId":"6600753004","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nsegments.keyword.ad_group_criterion,\nad_group_ad.ad.id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.interactions,\nmetrics.impressions\n                    FROM ad_group_ad\n                    WHERE segments.date BETWEEN '2024-01-01' AND '2024-01-28'\n                    AND campaign.status IN (ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN (ENABLED, PAUSED, REMOVED)\n                    AND ad_group_ad.status IN(ENABLED, PAUSED, REMOVED)\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-01' "}

Response
-------
Headers: {
    "request-id": "V_kDYTHeL-URYkJeImoEyQ",
    "date": "Mon, 29 Jan 2024 15:57:14 GMT",

    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------

Status code: 7
Details: The caller does not have permission

[Konstantin Tarassow]

Hello,

are there any news on this?

We still have 2 accounts which run into the Internal Error.

8875125139

-------

Method Name: /google.ads.googleads.v14.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",
    "x-goog-request-params": "customer_id=8875125139",
    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:

{"customerId":"8875125139","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nad_group_criterion.criterion_id,\nad_group_criterion.criterion_id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.impressions,\nmetrics.impressions\n                    FROM product_group_view\n                    WHERE segments.date BETWEEN '2024-01-10' AND '2024-01-10'\n                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.listing_group.type = 'UNIT'\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-10' "}

Response
-------
Headers: {
    "request-id": "IyQaAt-kGQOON5NocTeJNA",
    "date": "Fri, 09 Feb 2024 14:15:48 GMT",

    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------
Status code: 13
Details: Internal error encountered.

Failure: {"errors":[{"errorCode":{"internalError":"INTERNAL_ERROR"},"message":"An internal error has occurred."}],"requestId":"IyQaAt-kGQOON5NocTeJNA"}

7041860131

-------

Method Name: /google.ads.googleads.v14.services.GoogleAdsService/SearchStream
Host: googleads.googleapis.com
Headers: {
    "x-goog-api-client": "gl-php\/8.0.30 gccl\/19.2.0 gapic\/19.2.0 gax\/1.18.2 grpc\/1.50.2 rest\/1.18.2 pb\/+n",
    "x-goog-request-params": "customer_id=7041860131",
    "developer-token": "REDACTED",
    "login-customer-id": "4554523147"
}
Request:

{"customerId":"7041860131","query":"\n                    SELECT segments.date,\ncampaign.id,\nad_group.id,\nad_group_criterion.criterion_id,\nad_group_criterion.criterion_id,\nsegments.ad_network_type,\nsegments.device,\nmetrics.cost_micros,\nmetrics.clicks,\nmetrics.impressions,\nmetrics.impressions\n                    FROM product_group_view\n                    WHERE segments.date BETWEEN '2024-01-10' AND '2024-01-10'\n                    AND campaign.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.status IN(ENABLED, PAUSED, REMOVED)\n                    AND ad_group_criterion.listing_group.type = 'UNIT'\n                 AND metrics.impressions > 0  AND segments.date = '2024-01-10' "}

Response
-------
Headers: {
    "request-id": "-hXX-ebMy5pLNAU3ufwqcg",
    "date": "Fri, 09 Feb 2024 14:21:28 GMT",

    "alt-svc": "h3=\":443\"; ma=2592000,h3-29=\":443\"; ma=2592000"
}

Fault
-------
Status code: 13
Details: Internal error encountered.

Failure: {"errors":[{"errorCode":{"internalError":"INTERNAL_ERROR"},"message":"An internal error has occurred."}],"requestId":"-hXX-ebMy5pLNAU3ufwqcg"}

[Google Ads API Forum Advisor]

Sorry that response on this has been slow. I just pinged the TL again.