Long delays downloading reports from API

[dcde...@equimedia.co.uk]

Hi, we are experiencing very long delays with downloading reports from the API today. Out of 10 reports which started around 06:02 UK time this morning only one has completed so far, and that took 4 hrs 39 minutes!!! Please see the ID's of all reports below:

815398750 (started at 06:02:11, finished at 10:42:19 - 04:39:00)

815398394 (created at 06:02:17, not yet finished)

815398464 (created at 06:02:23, not yet finished)

815398673 (created at 06:02:28, not yet finished)

815399408 (created at 06:02:33, not yet finished)

815399504 (created at 06:02:39, not yet finished)

815399515 (created at 06:02:44, not yet finished)

815399521 (created at 06:02:49, not yet finished)

815399557 (created at 06:02:55, not yet finished)

815399658 (created at 06:03:01, not yet finished)

Please investigate urgently why there is such a long delay with generating reports today - please also note that yesterday it took over 12 hrs to get all our daily reports (10 in total), so it may be an ongoing issue. 

We appreciate your prompt reply and speedy resolution.

Thanks,

Tim Hooper.

[DCM API (DoubleClick Campaign Mgr)]

Hi Tim,

Thank you for raising this to us. 

The team already investigated this and find out that the reason you're getting this error is because of many concurrent executions/report runs and got deprioritized in the execution queue. With this, we recommend to check our quota guide related to this here: https://support.google.com/campaignmanager/answer/2823861#zippy=%2Creport-builder-quotas 

Regards,

Teejay Wennie Pimentel DCM API Team

ref:_00D1U1174p._5004Q2GK5XB:ref

[dcde...@equimedia.co.uk]

Hi Teejay,

Thanks for the reply but I don't believe this is the correct reason for the delays we are experiencing as we are only requesting around 20 reports over the space of 2 hours, and with a 5 second delay between each request, so we are well within our quota limits. The reports eventually downloaded yesterday after over 7 hours, but we are experiencing big delays again today, so please investigate this issue more thoroughly and provide a satisfactory answer and timescale for resolving the issue.

Many thanks,

Tim.

[dcde...@equimedia.co.uk]

Hi Teejay, correction it was actually over 9 hours yesterday, and over 12 hours the day before. We always run around 20 reports each day using the API and have been doing so for quite a few years now, and usually the reports would only take 20 minutes or less to download. Please investigate and resolve this issue urgently.

Thanks,

Clive.

[DCM API (DoubleClick Campaign Mgr)]

Hi Tim and Clive,

Thank you for getting back to us. Let me relay this information to the team to get their insight as well. I'll let you know the soonest I hear back.

[Chris Baclig]

I'll add that I've also started noticing increasingly slower reports generation since around 4/27. Reports have started taking upwards of 7 hours to generate (today) where previously the exact same report with an approximately similar number of rows had taken at most 10 minutes. (network ID: 1408331, report: ID:  787908223, below times are in PDT)

Chris

[DCM API (DoubleClick Campaign Mgr)]

Hi Chris,

Thank you for providing additional information. The team is now currently investigating the behavior. I'll update you the soonest they share their findings.

[Chris Baclig]

Since it's been a week, any updates on the investigation? I'm still seeing the same behavior of long running reports.

[DCM API (DoubleClick Campaign Mgr)]

Hi Chris,

Thank you for your patience - I've connected with the team on this case, and at this time, I'm afraid that this is still under investigation. I've followed up again with the team to see if there is something they can provide and will let you know when I hear back.

[dcde...@equimedia.co.uk]

Hi Teejay, the long running reports issue seems to have been mostly resolved for us, although reports are still taking around an hour to run, when previously they were taking 20 minutes or less, so still somewhat of an issue it seems. Thanks Chris for chasing, and yes it would be good to find out the reason for these delays please Teejay. Thanks.

[DCM API (DoubleClick Campaign Mgr)]

Hi there,

Thank you for updating us. Let me circle this back to the team and get their insight on what could be the reason on these reporting delays. I'll let you know the soonest they provide their feedback.

[DCM API (DoubleClick Campaign Mgr)]

Hi there,

Thank you for your patience. 

The team provided their feedback, and mentioned that you may experience report delays behavior when you run the report to the time when system is the busiest. In this case, it's between 2AM - 8AM US eastern time. The team also mentioned to expect slowness and the performance would not be consistent.