BatchJobs - Huge processing times since last night

[Thorsten Merz]

Hey there,

since last night (8 hours ago) we started to have increasing processing times on our batch job executions up to a point where the job takes longer than 2000 seconds to finish (if at all). Our usual average normally is around 15 seconds.

Examples are attached incl. batch job IDs

Some fix for this would be appreciated.

Regards

[Jan]

Same here. We have batch jobs with only 2 operations which take more then 90! minutes to complete.

Please look in to this problem asap!

[di...@adscale.com]

Same here. Jobs that usually take seconds need hours today.

[Anash P. Oommen (AdWords API Team)]

Folks,

We had an ongoing issue that caused these delays. The issue should be fixed now, but if you continue to see delays, feel free to update this thread and I'll investigate.

Cheers

Anash P. Oommen,
AdWords API Advisor.

[Thorsten Merz]

Thanks for the info... sadly we are still experiencing the same issue.

Find attached a list of our latest batch job ids.

--

[Anash P. Oommen (AdWords API Team)]

Hi Thorsten,

Thanks for reporting. Looks like batch jobs are still having issues. We are investigating...

Cheers

Anash P. Oommen,

AdWords API Advisor.

[Mariusz Wojcik]

And same here. All batch jobs are taking ages.

[Jan]

Same here, no increase in either the long running batchjobs but also not in the newly started...

Newly started: 846351403 (2 operations, already running 5 minutes)

Long running: 846104309 (running for over an hour for 6 operations)

[stanislav...@stylelounge.de]

We are still experiencing a similar issue too. A small batch job of less than a thousand operations never gets beyond zero in numOperationsExecuted and estimatedPercentExecuted.

On Thursday, September 13, 2018 at 3:23:40 PM UTC+2, Anash P. Oommen (AdWords API Team) wrote:

[Jan]

Seems our problems with the BatchJobService are solved.

BatchJobService times are back to seconds instead of hours.

Thanks for solving it!

[Thorsten Merz]

I can confirm that for the moment batch jobs are running at the normal speed.

Thanks for the support and solving the issue.

--

[Anash P. Oommen (AdWords API Team)]

Hi Thorsten,

I can confirm that the issue has been fixed at our end, and we are seeing normal throughput for BatchJobs. Feel free to ping this thread if you continue seeing issues.

Cheers

Anash P. Oommen,

AdWords API Advisor.

[Thorsten Merz]

Hi,

after observing the BatchJob performance over the weekend I must say, that the while the performance has greatly increased since the problems of last week, they are not back to "normal values" yet. Most of our batch jobs usually took an avg of 10-15 seconds to finish. Currently the avg is still at 3-4 times that with around almost 1 minute processing time.

Any chance to get back the performance of last week for the batch jobs?

Regards

[Thorsten Merz]

Hey,

so far it's looking a lot better and most of the time the runtime is back to the previous values. There are still some smaller peaks here and there, but overall looks good.

Hopefully it will continue to get better and stay stable. How about some VIP access to the Google API for large companies with lots of traffic? :P

Regards

[Thorsten Merz]

Hey there,

seems we are back into higher processing times again since last night. Not as bad as it was originally, but still going up. 

I really dont want to be mean, but these issues need to be fixed permamently as soon as possible, as there is currently no reliability to the AdWords BatchJob processing.

Execution of nearly 100.000 operations throughout several batch jobs per day is starting to cause problems with delays like these taking overhand.

Regards

[Thorsten Merz]

Good morning,

since last night we are once again having bad performance on the batch jobs. Find attached the latest set of Batch Job IDs and processing times. Normal avg.: 15 secs.

Is there a way to provide a permament fix for this issue, since it is happening almost on a weekly schedule.

Regards