MutateAds INTERNAL_ERROR

[Sergey Zilberman]

Hi all!
For some Edit ads we get an Internal Error.
On retry, the error is repeated.

Logs:


2021-02-16 10:52:36 - google Request made: Host: "googleads.googleapis.com", Method: "/google.ads.googleads.v6.services.AdService/MutateAds", CustomerId: 8850164670, RequestId: "9ttxAvwx0WHmvTh4ji0NQg", IsFault: 1, FaultMessage: "["An internal error has occurred."]"

2021-02-16 10:52:36 - google Request

-------

Method Name: /google.ads.googleads.v6.services.AdService/MutateAds

Host: googleads.googleapis.com

Headers: {

    "x-goog-api-client": "gl-php\/7.2.11 gapic\/ gax\/1.7.0 grpc\/1.33.1",

    "x-goog-request-params": "customer_id=8850164670",

    "developer-token": "REDACTED",

    "login-customer-id": "8850164670"

}

Request: 

{"customerId":"8850164670","operations":[{"updateMask":"resourceName,appAd.headlines,appAd.descriptions,appAd.images,appAd.youtubeVideos,appAd.html5MediaBundles","update":{"resourceName":"customers\/8850164670\/ads\/461740353102","appAd":{"headlines":[{"text":"LEGO® Life: Grenzenloser Spaß."},{"text":"LEGO® Life: Bauen ganz neu."},{"text":"LEGO® Life: Endloser Bauspaß."},{"text":"Ein Bau-Fest, das nie endet."},{"text":"Der Spaß hat kein Ende."}],"descriptions":[{"text":"Fördere die Kreativität deiner Kinder mit LEGO® Life, jederzeit & überall."},{"text":"Mit der ganzen Familie das LEGO® Life leben mit Quiz, Bau-Tipps, Videos & vielem mehr."},{"text":"Lustige Familienmomente teilen mit den LEGO® Life Challenges."},{"text":"Entdecke eine Welt voller Spaß & sicherer Inhalte, die die Fantasie deiner Kids anregen."},{"text":"LEGO® Life bietet Kindern coole interaktive Bau-Projekte & lustige Herausforderungen."}],"images":[{"asset":"customers\/8850164670\/assets\/11513579641"},{"asset":"customers\/8850164670\/assets\/11526210066"},{"asset":"customers\/8850164670\/assets\/11513580031"},{"asset":"customers\/8850164670\/assets\/11513580064"},{"asset":"customers\/8850164670\/assets\/11513581600"},{"asset":"customers\/8850164670\/assets\/11526210069"},{"asset":"customers\/8850164670\/assets\/11526210720"},{"asset":"customers\/8850164670\/assets\/11526210786"},{"asset":"customers\/8850164670\/assets\/11526210792"},{"asset":"customers\/8850164670\/assets\/11526210813"},{"asset":"customers\/8850164670\/assets\/11529015713"},{"asset":"customers\/8850164670\/assets\/11526211086"},{"asset":"customers\/8850164670\/assets\/11526211506"},{"asset":"customers\/8850164670\/assets\/11529015629"},{"asset":"customers\/8850164670\/assets\/11529010142"},{"asset":"customers\/8850164670\/assets\/11529012713"},{"asset":"customers\/8850164670\/assets\/11529012722"},{"asset":"customers\/8850164670\/assets\/11529015197"},{"asset":"customers\/8850164670\/assets\/11529015437"},{"asset":"customers\/8850164670\/assets\/11529015569"}],"youtubeVideos":[{"asset":"customers\/8850164670\/assets\/9845987463"},{"asset":"customers\/8850164670\/assets\/9846063375"},{"asset":"customers\/8850164670\/assets\/9849384842"},{"asset":"customers\/8850164670\/assets\/11507952889"},{"asset":"customers\/8850164670\/assets\/11520729813"},{"asset":"customers\/8850164670\/assets\/11523502940"},{"asset":"customers\/8850164670\/assets\/11543601849"},{"asset":"customers\/8850164670\/assets\/11545136084"},{"asset":"customers\/8850164670\/assets\/11545168634"},{"asset":"customers\/8850164670\/assets\/12380968108"},{"asset":"customers\/8850164670\/assets\/12388818749"}],"html5MediaBundles":[{"asset":"customers\/8850164670\/assets\/10234190161"},{"asset":"customers\/8850164670\/assets\/10234191100"},{"asset":"customers\/8850164670\/assets\/10251959403"},{"asset":"customers\/8850164670\/assets\/10253410511"},{"asset":"customers\/8850164670\/assets\/10253412356"},{"asset":"customers\/8850164670\/assets\/10253412362"},{"asset":"customers\/8850164670\/assets\/10253412365"},{"asset":"customers\/8850164670\/assets\/10253416838"},{"asset":"customers\/8850164670\/assets\/11508130315"},{"asset":"customers\/8850164670\/assets\/11520905016"},{"asset":"customers\/8850164670\/assets\/11520905025"},{"asset":"customers\/8850164670\/assets\/11523505528"},{"asset":"customers\/8850164670\/assets\/11523505792"},{"asset":"customers\/8850164670\/assets\/11523692822"},{"asset":"customers\/8850164670\/assets\/11536314348"},{"asset":"customers\/8850164670\/assets\/11538409529"}]}}}]}

Response

-------

Headers: {

    "request-id": "9ttxAvwx0WHmvTh4ji0NQg",

    "date": "Tue, 16 Feb 2021 10:52:35 GMT",

    "alt-svc": "h3-29=\":443\"; ma=2592000,h3-T051=\":443\"; ma=2592000,h3-Q050=\":443\"; ma=2592000,h3-Q046=\":443\"; ma=2592000,h3-Q043=\":443\"; ma=2592000,quic=\":443\"; ma=2592000; v=\"46,43\""

}

Fault

-------

Status code: 13

Details: Internal error encountered.

Failure: {"errors":[{"errorCode":{"internalError":"INTERNAL_ERROR"},"message":"An internal error has occurred."}]}

[Google Ads API Forum Advisor Prod]

Hello Sergey,

Thank you for providing all this information. Is this only for ad mutates, or does this happen for multiple services? How often are you seeing this?

The initial stack trace I looked at on our servers doesn't appear to have a reason, so I'm going to chat with my fellow engineer who worked on that piece of code to see if he knows why. I'll get back to you when I hear back from him.

Cheers,
Nadine Wang, Google Ads API Team

ref:_00D1U1174p._5004Q2CRNtz:ref

[Sergey Zilberman]

Hello Nadine.
Our client only informed us about a problem with editing some ads (not all). Moreover, we tried to send all the same data (without new elements) that has already been saved, but we still see an error.
We see this error for the first time in all our long work with Google API.

Cheers,
Sergey

[Google Ads API Forum Advisor Prod]

Hello Sergey,

Thank you for the additional information and for bringing this to our attention. I'm still waiting for my fellow engineer who works on the code to get back to me. I'll get back to you when I hear back. Feel free to ping this thread if you don't hear from me soon.

Cheers,
Nadine, Google Ads API Team 

ref:_00D1U1174p._5004Q2CRNtz:ref

[Sergey Zilberman]

Hello Nadine.
When is the answer supposed to be? The client asks us when there will be a solution to the problem..

Thanks,
Sergey

[Google Ads API Forum Advisor Prod]

Hello Sergey,

It's difficult to determine the timeline because we haven't found the root cause, yet. One or my fellow engineers has taken a look, but didn't see the reason in one part of the code, so it has been sent over to another engineer to take a look. It looks like this may not be straightforward so it may take some time to get to the bottom of it. I'll reach out if I need additional information.

Best,

[Google Ads API Forum Advisor Prod]

Hello Sergey,

Here's a quick update. We think we found the root cause. We're now working on confirming it. We'll get back to you once it's confirmed.

Cheers,

[Sergey Zilberman]

Hello Nadine.
Thanks for the update!

We are waiting.

Sergey

[Google Ads API Forum Advisor Prod]

Hello Sergey,

It appears the reason this is happening is because these particular assets are in an odd state in our system. The YouTube video associated with the asset seems to have an ID of zero, which is unexpected. We're currently working on updating our code to handle this better. I don't have an estimate for the fix, yet. I'll keep you updated.

Regards,

[Google Ads API Forum Advisor Prod]

Hello Sergey,

It looks like we were able to put a fix in for this. Can you please give it another try?

Thanks,