BatchJobService HTTP 503 Service Unavailable - [URGENT]

663 views
Skip to first unread message

Biniam Asnake

unread,
Feb 23, 2016, 8:33:20 AM2/23/16
to AdWords API Forum
I am running large jobs on Google using BatchJobService and I got this exception.

The exception was followed by StackoverFlowException which finally broke tomcat.

Any idea? Any fix?

This code is already in production (no bug while testing) and I need urgent solution.

Thanks.

2016-02-23 11:59:43,565 [AdwordsJobExecutor-akka.actor.default-dispatcher-1107] WARN
 com
.google.api.ads.adwords.lib.utils.batch_job.logUpload([...]) at Line 74
FAILED
(null) batch job upload to https://www.googleapis.com/upload/storage/v1/b/batch-job-upload-prod-ebe9b43/o?uploadType=resumable&upload_id=AEnB2UrYlOJfNSy-IcYwZ_PKHxkSYEX-2WYpJqBGEW5VNkEEsINqDke5U_tD5V6Z-VW1TtAQeM6EzFplEjmsvbQruRcM_qjK5g. Exception: com.google.api.client.http.HttpResponseException: 503 Service Unavailable
Service Unavailable


2016-02-23 11:59:43,711 [AdwordsJobExecutor-akka.actor.default-dispatcher-1109] ERROR
 
StackTrace.invoke0([...]) at Line ?
Full Stack Trace:


com
.google.api.client.http.HttpResponseException: 503 Service Unavailable
Service Unavailable
 at com
.google.api.client.http.HttpRequest.execute(HttpRequest.java:1061)
 at com
.google.api.ads.adwords.lib.utils.BatchJobUploader.uploadBatchJobOperations(BatchJobUploader.java:114)
 at com
.google.api.ads.adwords.axis.utils.v201509.batchjob.BatchJobHelper.uploadBatchJobOperations(BatchJobHelper.java:82)
 at com
.google.api.ads.adwords.lib.utils.BatchJobHelperInterface$uploadBatchJobOperations.call(Unknown Source)
 at com
.bonial.megan.helpers.BatchProcessingServiceHelper.uploadOperations(BatchProcessingServiceHelper.groovy:117)
 at com
.bonial.megan.helpers.BatchProcessingServiceHelper$uploadOperations$23.callStatic(Unknown Source)
 at com
.bonial.megan.services.BatchProcessingService.createAndUploadBatchJobOperations(BatchProcessingService.groovy:62)
 at com
.bonial.megan.services.BatchProcessingService$createAndUploadBatchJobOperations$0.call(Unknown Source)
 at com
.bonial.megan.execution.actors.stateChange.mutate.StateChangeMutateActor$_onReceiveBody_closure1.doCall(StateChangeMutateActor.groovy:42)
 at sun
.reflect.GeneratedMethodAccessor932.invoke(Unknown Source)
 at sun
.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java
.lang.reflect.Method.invoke(Method.java:483)
 at org
.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
 at groovy
.lang.MetaMethod.doMethodInvoke(MetaMethod.java:324)
 at groovy
.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1207)
 at groovy
.lang.ExpandoMetaClass.invokeMethod(ExpandoMetaClass.java:1121)
 at groovy
.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1016)
 at groovy
.lang.Closure.call(Closure.java:423)
 at org
.codehaus.groovy.runtime.DefaultGroovyMethods.callClosureForMapEntry(DefaultGroovyMethods.java:5223)
 at org
.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:2104)
 at org
.codehaus.groovy.runtime.dgm$163.invoke(Unknown Source)
 at org
.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:271)
 at org
.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)
 at org
.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:122)
 at com
.bonial.megan.execution.actors.stateChange.mutate.StateChangeMutateActor.onReceiveBody(StateChangeMutateActor.groovy:41)
 at com
.bonial.megan.execution.actors.stateChange.mutate.StateChangeMutateActor$onReceiveBody$2.callCurrent(Unknown Source)
 at com
.bonial.megan.execution.actors.AbstractActor.onReceive(AbstractActor.groovy:41)
 at akka
.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
 at akka
.actor.Actor$class.aroundReceive(Actor.scala:465)
 at akka
.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
 at akka
.actor.ActorCell.receiveMessage(ActorCell.scala:516)
 at akka
.actor.ActorCell.invoke_aroundBody0(ActorCell.scala:487)
 at akka
.actor.ActorCell$AjcClosure1.run(ActorCell.scala:1)
 at org
.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
 at akka
.kamon.instrumentation.ActorCellInstrumentation$$anonfun$aroundBehaviourInvoke$1.apply(ActorCellInstrumentation.scala:62)
 at kamon
.trace.Tracer$.withContext(TracerModule.scala:57)
 at akka
.kamon.instrumentation.ActorCellInstrumentation.aroundBehaviourInvoke(ActorCellInstrumentation.scala:61)
 at akka
.actor.ActorCell.invoke(ActorCell.scala:483)
 at akka
.dispatch.Mailbox.processMailbox(Mailbox.scala:254)
 at akka
.dispatch.Mailbox.run(Mailbox.scala:221)
 at akka
.dispatch.Mailbox.exec(Mailbox.scala:231)
 at scala
.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
 at scala
.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
 at scala
.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
 at scala
.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

Umesh Dengale

unread,
Feb 23, 2016, 12:19:53 PM2/23/16
to AdWords API Forum
Hello,

Thanks for attaching the full stack trace. The above error could be transient. Could you retry above API call? Please let us know if you still experience the issue.

Regards,
Umesh, AdWords API Team.

Biniam Asnake

unread,
Feb 24, 2016, 10:24:30 AM2/24/16
to AdWords API Forum
This issue happened again and killed tomcat. Please help.

Josh Radcliff (AdWords API Team)

unread,
Feb 24, 2016, 11:07:38 AM2/24/16
to AdWords API Forum
Hi,

Did you retry the request, as Umesh suggested in his earlier reply? Since BatchJobService uploads go to Google Cloud Storage, you should implement retry logic if you are encountering 408, 500, 502, 503, or 504 errors -- please see Recommended practices in the Google Cloud Storage guide for details.

Thanks,
Josh, AdWords API Team

Biniam Asnake

unread,
Feb 25, 2016, 7:08:11 AM2/25/16
to AdWords API Forum
I am retrying the requests but still getting errors.
The error I got now is: org.xml.sax.SAXParseException; lineNumber: 965; columnNumber: 19; The element type "biddingStrategyConfiguration" must be terminated by the matching end-tag "</biddingStrategyConfiguration>".

Please investigate and fix ASAP since my application is in production.

Thank you.

Here is the stacktrace.

com.google.api.ads.adwords.lib.utils.BatchJobException: Failed to download batch job mutate response from URL: https://batch-job-download-prod-ebe9b43.storage.googleapis.com/123572580/1280929.results.xml?GoogleAccessId=926043054183-rbu1gk


dushnqrfcf47gser4u8qse2ig4@developer.gserviceaccount.com&Expires=1458989812&Signature=UNjnChtcUX%2FBNtLpSDz22GReDMoH5xNqzIxjivf0faO3ZrtqWx6VN%2B0w21nTzq1HG73y40Ww3tsd9rBEk7lsyYN5Qhuhmt1dQCeSfOs%2BVLF%2FMuX030ys1TSf7e%2F1gHwY5tgwxFfr%2FrAF


7XwdhI6ykCw268HFNYaI1q0BfXK60R%2FUMtzUMpwMc2Ie92FkaEMVDopI02hFufnp%2FXBnJg6P67yPaToa3j0gXRP31trNABUmKRKs4Wtd3k5UlIX7JrYUFJizR5VlK9m5xJcZSvVC181yDxcjBJHaZEVQy7MJfFRK9L2t7lgnWY0Ks6PGrrdlMM6w7%2FQTw8rZrQDYjS7hHg%3D%3D


        at com.google.api.ads.adwords.axis.utils.v201509.batchjob.BatchJobHelper.downloadBatchJobMutateResponse(BatchJobHelper.java:105)


        at com.google.api.ads.adwords.axis.utils.v201509.batchjob.BatchJobHelper.downloadBatchJobMutateResponse(BatchJobHelper.java:54)


        at com.google.api.ads.adwords.lib.utils.BatchJobHelperInterface$downloadBatchJobMutateResponse$17.call(Unknown Source)


        at com.bonial.megan.helpers.BatchProcessingServiceHelper.retrieveMutateResults(BatchProcessingServiceHelper.groovy:271)


        at com.bonial.megan.helpers.BatchProcessingServiceHelper$retrieveMutateResults$40.callStatic(Unknown Source)


        at com.bonial.megan.services.BatchProcessingService.handleDoneBatchJob(BatchProcessingService.groovy:199)


        at sun.reflect.GeneratedMethodAccessor677.invoke(Unknown Source)


        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)


        at java.lang.reflect.Method.invoke(Method.java:483)


        at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:207)


        at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)


        at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:171)


        at com.bonial.megan.services.BatchProcessingService.handleBatchJobCompletionStatus(BatchProcessingService.groovy:91)


        at com.bonial.megan.services.BatchProcessingService$handleBatchJobCompletionStatus$0.call(Unknown Source)


        at com.bonial.megan.execution.actors.stateChange.mutate.StateChangeStatusCheckerActor.onReceiveBody(StateChangeStatusCheckerActor.groovy:30)


        at com.bonial.megan.execution.actors.stateChange.mutate.StateChangeStatusCheckerActor$onReceiveBody.callCurrent(Unknown Source)


        at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49)


        at com.bonial.megan.execution.actors.stateChange.mutate.StateChangeStatusCheckerSupervisor$onReceiveBody.callCurrent(Unknown Source)


        at com.bonial.megan.execution.actors.AbstractActor.onReceive(AbstractActor.groovy:41)


        at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)


        at akka.actor.Actor$class.aroundReceive(Actor.scala:465)


        at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)


        at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)


        at akka.actor.ActorCell.invoke_aroundBody0(ActorCell.scala:487)


        at akka.actor.ActorCell$AjcClosure1.run(ActorCell.scala:1)


        at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)


        at akka.kamon.instrumentation.ActorCellInstrumentation$$anonfun$aroundBehaviourInvoke$1.apply(ActorCellInstrumentation.scala:62)


        at kamon.trace.Tracer$.withContext(TracerModule.scala:57)


        at akka.kamon.instrumentation.ActorCellInstrumentation.aroundBehaviourInvoke(ActorCellInstrumentation.scala:61)


        at akka.actor.ActorCell.invoke(ActorCell.scala:483)


        at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)


        at akka.dispatch.Mailbox.run(Mailbox.scala:221)


        at akka.dispatch.Mailbox.exec(Mailbox.scala:231)


        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)


        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)


        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)


        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)


Caused by: org.xml.sax.SAXParseException; lineNumber: 965; columnNumber: 19; The element type "biddingStrategyConfiguration" must be terminated by the matching end-tag "</biddingStrategyConfiguration>".


        at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:203)


        at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)


        at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:441)


        at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:368)


        at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1436)


        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1749)


        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2973)


        at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)


        at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:117)


        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510)


        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)


        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)


        at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)


        at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)


        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:649)


        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:333)


        at org.apache.axis.encoding.DeserializationContext.parse(DeserializationContext.java:227)

Biniam Asnake

unread,
Feb 25, 2016, 7:10:09 AM2/25/16
to AdWords API Forum

Additional information: This log repeated for a while and caused StackOverflowError which killed tomcat.


On Wednesday, February 24, 2016 at 5:07:38 PM UTC+1, Josh Radcliff (AdWords API Team) wrote:

Josh Radcliff (AdWords API Team)

unread,
Feb 25, 2016, 8:30:18 AM2/25/16
to AdWords API Forum
Hi,

Could you provide me with the following?
  1. The clientCustomerId of the account.
  2. The BatchJob.id corresponding to the download that failed.
Thanks,
Josh, AdWords API Team

Biniam Asnake

unread,
Mar 8, 2016, 4:38:24 AM3/8/16
to AdWords API Forum
This issue is still happening. I am retrying the job but failing again.

Here is the new stacktrace.

Please help.

2016-03-07 19:10:16,859 [AdwordsJobExecutor-akka.actor.default-dispatcher-51] WARN 
com.google.api.ads.adwords.lib.utils.batch_job.logUpload([...]) at Line 74 
Service Unavailable

2016-03-07 19:10:16,861 [AdwordsJobExecutor-akka.actor.default-dispatcher-51] ERROR 
com.bonial.megan.services.BatchProcessingService.call([...]) at Line ? 
Error uploading operations to Google Adwords

com.google.api.client.http.HttpResponseException: 503 Service Unavailable
Service Unavailable
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1061)
at com.google.api.ads.adwords.lib.utils.BatchJobUploader.uploadBatchJobOperations(BatchJobUploader.java:114)
at com.google.api.ads.adwords.axis.utils.v201509.batchjob.BatchJobHelper.uploadBatchJobOperations(BatchJobHelper.java:82)
at com.bonial.megan.helpers.BatchProcessingServiceHelper.uploadOperations(BatchProcessingServiceHelper.groovy:117)
at com.bonial.megan.services.BatchProcessingService.createAndUploadBatchJobOperations(BatchProcessingService.groovy:62)
at com.bonial.megan.execution.actors.forcedSwitchOff.mutate.ForcedSwitchOffMutateActor$_onReceiveBody_closure1.doCall(ForcedSwitchOffMutateActor.groovy:40)
at com.bonial.megan.execution.actors.forcedSwitchOff.mutate.ForcedSwitchOffMutateActor.onReceiveBody(ForcedSwitchOffMutateActor.groovy:39)
at com.bonial.megan.execution.actors.AbstractActor.onReceive(AbstractActor.groovy:41)
at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
at akka.actor.Actor$class.aroundReceive(Actor.scala:465)
at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
at akka.actor.ActorCell.invoke_aroundBody0(ActorCell.scala:487)
at akka.actor.ActorCell$AjcClosure1.run(ActorCell.scala:1)
at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
at akka.kamon.instrumentation.ActorCellInstrumentation$$anonfun$aroundBehaviourInvoke$1.apply(ActorCellInstrumentation.scala:62)
at kamon.trace.Tracer$.withContext(TracerModule.scala:57)
at akka.kamon.instrumentation.ActorCellInstrumentation.aroundBehaviourInvoke(ActorCellInstrumentation.scala:61)
at akka.actor.ActorCell.invoke(ActorCell.scala:483)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254)
at akka.dispatch.Mailbox.run(Mailbox.scala:221)
at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2016-03-07 19:10:16,878 [AdwordsJobExecutor-akka.actor.default-dispatcher-35] ERROR 
com.bonial.megan.execution.actors.forcedSwitchOff.mutate.ForcedSwitchOffMutateSupervisor.invoke0([...]) at Line ? 
BatchJobException [Problem sending data to batch upload URL.] detected. Caused by: 




com.google.api.ads.adwords.lib.client.AdWordsServiceClient.soapXmlLogger.logSoapXml([...]) at Line 83 
SOAP Request:
<?xml version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
    <soapenv:Header>
        <ns1:RequestHeader xmlns:ns1="https://adwords.google.com/api/adwords/cm/v201509" soapenv:mustUnderstand="0">
            <ns1:clientCustomerId>1621197255</ns1:clientCustomerId>
            <ns1:developerToken>MYDEVELOPERTOKEN</ns1:developerToken>
            <ns1:userAgent>began:1.0.0 (AwApi-Java, AdWords-Axis/2.7.0, Common-Java/2.7.0, Axis/1.4, Java/1.8.0_25, maven)</ns1:userAgent>
            <ns1:validateOnly>false</ns1:validateOnly>
            <ns1:partialFailure>true</ns1:partialFailure>
        </ns1:RequestHeader>
    </soapenv:Header>
    <soapenv:Body>
            <operations>
                <operator>ADD</operator>
                <operand/>
            </operations>
        </mutate>
    </soapenv:Body>
</soapenv:Envelope>


2016-03-07 19:10:49,266 [AdwordsJobExecutor-akka.actor.default-dispatcher-59] WARN 
com.google.api.ads.adwords.lib.client.AdWordsServiceClient.soapXmlLogger.logSoapXml([...]) at Line 84 
SOAP Response:
<?xml version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
    <soapenv:Body>
        <soapenv:Fault>
            <faultcode xmlns:ns1="http://xml.apache.org/axis/">ns1:HTTP</faultcode>
            <faultstring>(502)Bad Gateway</faultstring>
            <detail>
                <string>return code:  502
&lt;!DOCTYPE html&gt;
&lt;html lang=en&gt;
  &lt;meta charset=utf-8&gt;
  &lt;meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width"&gt;
  &lt;title&gt;Error 502 (Server Error)!!1&lt;/title&gt;
  &lt;style&gt;
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* &gt; body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  &lt;/style&gt;
  &lt;a href=//www.google.com/&gt;&lt;span id=logo aria-label=Google&gt;&lt;/span&gt;&lt;/a&gt;
  &lt;p&gt;&lt;b&gt;502.&lt;/b&gt; &lt;ins&gt;That’s an error.&lt;/ins&gt;
  &lt;p&gt;The server encountered a temporary error and could not complete your request.&lt;p&gt;Please try again in 30 seconds.  &lt;ins&gt;That’s all we know.&lt;/ins&gt;
</string>
                <ns2:HttpErrorCode xmlns:ns2="http://xml.apache.org/axis/">502</ns2:HttpErrorCode>
            </detail>
        </soapenv:Fault>
    </soapenv:Body>
</soapenv:Envelope>



robert....@mercadolibre.com

unread,
Mar 8, 2016, 9:08:57 AM3/8/16
to AdWords API Forum
I've experimented similar issues yesterday when trying to create new keywords using BatchJobs: 

BatchJobException: Failed to download batch job mutate response from URL: https://batch-job-download-prod-ebe9b43.storage.googleapis.com/8976...

All our jobs failed. 
Was there any problems with this service yesterday? We didn't make any modifications on the application and the process has been working fine por some time now.

Thank you.

Josh Radcliff (AdWords API Team)

unread,
Mar 8, 2016, 9:29:08 AM3/8/16
to AdWords API Forum
Hi,

When that error occurred, did you retry your request after waiting a few seconds? Those errors look like temporary errors that may have gone away on retry.

Thanks,
Josh, AdWords API Team

robert....@mercadolibre.com

unread,
Mar 8, 2016, 9:56:07 AM3/8/16
to AdWords API Forum

Hi Josh, thanks for your advice.
We are just doing that, adding a retry logic to get the results and if it still fails wait some minutes before retrying again.
The odd thing is that all the jobs failed (dozens) and we were not able to retrieve the result from any of them.

I will do this and will let you know.


Thanks,

Regards.

Biniam Asnake

unread,
Mar 8, 2016, 10:06:35 AM3/8/16
to robert....@mercadolibre.com, AdWords API Forum
Yes Josh. I am retrying it using fault tolerance capabilities of Akka.io but failing 2 times in a row.

--
--
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog and Google+:
https://googleadsdeveloper.blogspot.com/
https://plus.google.com/+GoogleAdsDevelopers/posts
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
 
You received this message because you are subscribed to the Google
Groups "AdWords API Forum" group.
To post to this group, send email to adwor...@googlegroups.com
To unsubscribe from this group, send email to
adwords-api...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "AdWords API Forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/adwords-api/3zDAb_Sgl80/unsubscribe.
To unsubscribe from this group and all its topics, send an email to adwords-api...@googlegroups.com.
Visit this group at https://groups.google.com/group/adwords-api.
To view this discussion on the web visit https://groups.google.com/d/msgid/adwords-api/69235700-ef67-4f2e-9466-919d905b4254%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Biniam Asnake

Lead Software Engineer (M.Sc. Information Science)

Email: biniam...@gmail.com

Blog: http://binyit.blogspot.com/

LinkedIn: https://www.linkedin.com/in/biniama


Josh Radcliff (AdWords API Team)

unread,
Mar 9, 2016, 12:57:46 PM3/9/16
to AdWords API Forum, robert....@mercadolibre.com
Hi,

Are you both still experiencing this issue? I only ask because I just tried submitting a batch job and was able to successfully download the results without any issues.

If you're still seeing this problem, please send me the following so I can investigate your particular jobs:
  • AdWords customer ID (xxx-xxx-xxxx) of the account
  • IDs of any BatchJobs with this problem
Thanks,
Josh, AdWords API Team


For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "AdWords API Forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/adwords-api/3zDAb_Sgl80/unsubscribe.
To unsubscribe from this group and all its topics, send an email to adwords-api+unsubscribe@googlegroups.com.

robert....@mercadolibre.com

unread,
Mar 11, 2016, 9:12:41 AM3/11/16
to AdWords API Forum, robert....@mercadolibre.com
Hi Josh.

We've added a new retry logic and today the service is running without problems, didn't have any issues so far.

Thanks for your support and from my side consider this closed.
Regards,

Robert.



For more options, visit this group at
http://groups.google.com/group/adwords-api?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "AdWords API Forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/adwords-api/3zDAb_Sgl80/unsubscribe.
To unsubscribe from this group and all its topics, send an email to adwords-api...@googlegroups.com.

krishnaven...@sparsolutions.com

unread,
Mar 18, 2016, 9:09:56 AM3/18/16
to AdWords API Forum, robert....@mercadolibre.com

com.google.api.client.http.HttpResponseException: 503 Service Unavailable

com.google.api.client.http.HttpResponseException: 503 Service Unavailable
{
 "error": {
  "errors": [
   {
    "domain": "global",
    "reason": "backendError",
    "message": ""
   }
  ],
  "code": 503,
  "message": ""
 }
}

    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1061)
    at com.emailarchive.web.googlerestspring.endpointstest.EmailArchiveRestServiceEndpointTest$2.run(EmailArchiveRestServiceEndpointTest.java:236)
    at java.lang.Thread.run(Thread.java:745)
com.google.api.client.http.HttpResponseException: 503 Service Unavailable
{
 "error": {
  "errors": [
   {
    "domain": "global",
    "reason": "backendError",
    "message": ""
   }
  ],
  "code": 503,
  "message": ""
 }
}

    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1061)
    at com.emailarchive.web.googlerestspring.endpointstest.EmailArchiveRestServiceEndpointTest$2.run(EmailArchiveRestServiceEndpointTest.java:236)
    at java.lang.Thread.run(Thread.java:745)
---------THREAD STATUS START---------

Josh Radcliff (AdWords API Team)

unread,
Mar 18, 2016, 9:31:08 AM3/18/16
to AdWords API Forum, robert....@mercadolibre.com
Hi,

When you encountered the error below, did you retry as mentioned in earlier posts?

Thanks,
Josh, AdWords API Team
Reply all
Reply to author
Forward
0 new messages