Suddenly unable to download report file

[Gavin Carpenter]

Hi, 

I'm suddenly having issues downloading report files using the Java library.

I get this error message:

Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden

<?xml version='1.0' encoding='UTF-8'?><Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method.</Message><StringToSign>GET

1551876506

x-goog-api-client:java/1.8.0 http-google-dfareporting/1.26.0 windows-10/10.0

/dfa_-8d0a839b29a42b578c23b872294e22719442c63a/5960_Temporary_Report_-_Billing_-_32439420748494089-0_20190306_124307_2095552966.csv</StringToSign></Error>

at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)

at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)

at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)

at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)

at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)

at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)

at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)

at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeMedia(AbstractGoogleClientRequest.java:476)

at com.google.api.services.dfareporting.Dfareporting$Files$Get.executeMedia(Dfareporting.java:14398)

at com.mediacom.billinginvoicecodechecker.BillingInvoiceCodeChecker.lambda$main$4(BillingInvoiceCodeChecker.java:186)

at net.jodah.failsafe.SyncFailsafe.call(SyncFailsafe.java:145)

... 2 more

This code previously worked fine and I should be using the latest DCM API version by pulling in the RELEASE version from Maven.

Any ideas what has suddenly gone wrong?

Thanks, 

Gavin

[dcmapi-fo...@google.com]

Hi,

Please send the following details:

1. Are you using 3.1 version of DCM API?
2. Are you able to download the file via the UI? If so, could you reply back with the Report id, file id, account id and profile id?
3. What is the scope of the API request?
4. Is DCM API enabled in Google Console?

You might find the following links useful:

https://github.com/googleapis/google-cloud-node/issues/1976

Thanks,

Lakshmi, DCM API Team

--
You received this message because you are subscribed to the Google Groups "Google's DoubleClick Campaign Manager API Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-doubleclick-for-advertisers-api+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Gavin Carpenter]

Hi Lakshmi, 

Thanks for getting back to me.

Answers to your questions:

1. As I mentioned in my original message I'm using the Java library marked as RELEASE in the maven repository. Currently this is version v3.3-rev20190206-1.28.0 which should be using version 3.3 of the API.
2. Yes I can download the file manually in the UI. The latest example my system has created has these details: Profile-845690, Report-524549826, File-2096361022.
3. The scope should be this one: https://www.googleapis.com/auth/dfareporting. As I'm using the library though this is all abstracted away from me. Overall the tokens being used for the system have the correct scopes enabled, see below.
4. Yes. This code always used to work, has done for years. The project associated hasn't changed etc. Also other calls to the API still work just fine, see below.
   

For some more detail:

• My system is able to successfully create a report using: dcm.reports().insert(profile.getProfileId(), report).execute()
• It can then start it running: dcm.reports().run(profile.getProfileId(), createdReport.getId()).execute()
• Periodically check the status querying the file returned from the above: dcm.files().get(profile.getProfileId(), reportFile.getId()).execute()
• Once reportFile.getStatus() returns "REPORT_AVAILABLE" I try to get the HttpResponse with: dcm.files().get(createdReport.getId(), reportFile.getId()).executeMedia() - this is the part that fails with the error message provided before.

Given that the other reporting calls work just fine there shouldn't be an issue with permissions or the scopes, etc. It looks like there is either an issue in the library or server side.

Thanks, 

Gavin

[dcmapi-fo...@google.com]

Hi Gavin,

For downloading the report file could you please use the code from this GitHub sample and let me know if it is still giving the same error?

[Gavin Carpenter]

Just tried this, after having to modify the example very slightly due to an issue with it adding a "/" in front of the clientSecretsFile path in DfaReportingFactory.java.

When I run the example I get the same error as before:

Exception in thread "main" com.google.api.client.http.HttpResponseException: 403 Forbidden

<?xml version='1.0' encoding='UTF-8'?><Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method.</Message><StringToSign>GET

1552042196

x-goog-api-client:java/1.8.0 http-google-dfareporting/1.26.0 windows-10/10.0

/dfa_-8d0a839b29a42b578c23b872294e22719442c63a/5960_Temporary_Report_-_Billing_-_26994733115725823-0_20190308_100426_2097006018.csv</StringToSign></Error>

at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1137)

at com.google.api.client.googleapis.media.MediaHttpDownloader.executeCurrentRequest(MediaHttpDownloader.java:244)

at com.google.api.client.googleapis.media.MediaHttpDownloader.download(MediaHttpDownloader.java:198)

at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeMediaAndDownloadTo(AbstractGoogleClientRequest.java:658)

at com.google.api.services.dfareporting.Dfareporting$Files$Get.executeMediaAndDownloadTo(Dfareporting.java:14388)

at com.google.api.services.samples.dfareporting.reports.DownloadFile.runExample(DownloadFile.java:51)

at com.google.api.services.samples.dfareporting.reports.DownloadFile.main(DownloadFile.java:76)

Does this work when you run the example?

[dcmapi-fo...@google.com]

Hi,

I am able to reproduce this issue. I escalated this issue internally to have a deeper look for the root cause of the issue. As a workaround, you might want to use API explorer. API explorer is working fine.

Thanks,

Lakshmi, DCM API Team

--

[Gavin Carpenter]

Ok thanks, glad it's not just me doing something wrong!

I'm not sure the API explorer helps me much more than going into the UI to download the report manually. I have a need to build, run and download a report across many networks to power a finance process so getting my API based system working again is pretty crucial.

Let me know when you have more details on what is wrong here.

Thanks!

[Gavin Carpenter]

Hi there, 

Any updates on this? 

We need to get this working again so that we can ensure that the correct information is in CM so that it appears on our invoices so we can pay you properly :)

Thanks, 

Gavin

[dcmapi-fo...@google.com]

Hi Gavin,

I completely understand your concerns. I sent this concern to rest of the team as well. The team is investigating this issue. I will update this thread once I have more information from them.

Thanks,

Lakshmi, DCM API Team

[dcmapi-fo...@google.com]

Hi Gavin,

The team provided the following workarounds for this issue:

1. Make the download requests manually (without using the client library) 
2. Use the library for a different language other than Java to make the requests.
3. Downgrade to an older version ( 1.25.0 or earlier) of the Java client library.

[consum...@unilever.com]

Hi Team,

I am also facing the same issue , could not able to download any reports. 

I have tried downgrading to the lower environment but still no luck

[dcmapi-fo...@google.com]

Hi,

Which version are you using as a workaround? Did you try the other option like manually making the calls with out using client library?

Thanks,

Lakshmi, DCM API Team

--

[Gavin Carpenter]

Hi Lakshmi, 

I hope these are just temporary workarounds. Changing to a different language for option 2 isn't exactly a viable option!

What is the ETA on a fix being made available for this clear issue?

Thanks, 

Gavin

[dcmapi-fo...@google.com]

Hi Gavin,

I completely understand your concern. I forwarded your concern to the rest of the team as well. As of now I have no ETA for this. I assure you that these are workarounds and the team is working on the fix. 

Thanks,

Lakshmi, DCM API Team

Hi Lakshmi, 

I hope these are just temporary workarounds. Changing to a different language for option 2 isn't exactly a viable option!

What is the ETA on a fix being made available for this clear issue?

Thanks, 

Gavin

On Wednesday, March 13, 2019 at 5:31:31 PM UTC, dcmapi-forumadvisor wrote:

Hi Gavin,

The team provided the following workarounds for this issue:

1. Make the download requests manually (without using the client library) 
2. Use the library for a different language other than Java to make the requests.
3. Downgrade to an older version ( 1.25.0 or earlier) of the Java client library.

Thanks,

Lakshmi, DCM API Team

--

[br...@agencywithin.com]

Seem to be dealing with a similar issue (using the Ruby client V3_2), but I also can't seem to be able to download reports from the UI.

[dcmapi-fo...@google.com]

Hi,

Are you still seeing this issue? If so, I recommend checking with general support team as this issue is not specific to API. This could be a product level issue.

Thanks,

Lakshmi, DCM API Team

On 03/15/19 09:53:08 

--

[Gavin Carpenter]

Hi Lakshmi, 

Hope you had a good weekend.

Any update on this?

It's now been a considerable time since this issue started.

We're having some issues rolling back to the older version of the API and really don't want to invest extensive development work into trying to get something old or alternative to work.

Please can you provide an ETA on this being fixed ASAP.

Thanks, 

Gavin

[dcmapi-fo...@google.com]

Hi Gavin,

We completely understand your concern. We have raised this internally and increased the priority on this issue. We will let you know as soon as the issue is fixed.

Thanks,

Lakshmi, DCM API Team

=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog and discussion group:
    http://googleadsdeveloper.blogspot.com/search/label/dfa_api
    https://developers.google.com/doubleclick-advertisers/community
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

[Gavin Carpenter]

Hi there, 

Chasing again on this.

To say once again, one of our systems still having issues we use to check that billing invoice codes are properly populated so that we can pay you correctly. With this API not working correctly for quite a while now we will be pointing to this as a reason for any late payment or other issues.

Thanks,

Gavin

[dcmapi-fo...@google.com]

Hi,

I apologize for the delayed response. I completely understand your concern. So, I sent this concern to the next level who is working on this issue to be aware of your concern. I will update this thread once I have more information regarding this issue.

Lakshmi, DCM API Team

=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~
Also find us on our blog and discussion group:
    http://googleadsdeveloper.blogspot.com/search/label/dfa_api
    https://developers.google.com/doubleclick-advertisers/community
=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~

[Gavin Carpenter]

Hi Lakshmi, 

Can I assume now from the lack of an update that this bug will not be fixed?

If so can you provide details about why this is?

Will there now no longer be any updates to Campaign Manager and its API?

Regards, 

Gavin

[DCM API (DoubleClick Campaign Mgr)]

Hi,

The product and the API are being actively worked on. There's no ETA to share for this particular issue. However, there are couple of workarounds for this issue:

1. Make the download requests manually (without using the client library) 
2. Use the library for a different language other than Java to make the requests.

3. Downgrade to an older version (1.25.0 or earlier) of the Java client library.

Link: https://search.maven.org/artifact/com.google.apis/google-api-services-dfareporting/v3.2-rev3-1.25.0/jar

Thanks,
Lakshmi, DCM API Team

ref:_00D1U1174p._5001UAq84I:ref

[Paul Stemmet]

Hi, I'm also being affected by this issue and downgrading to an earlier version doesn't work.

Any updates??

[Gavin Carpenter]

I managed to get the old version to work but only with the library example and not as a drop in replacement to my existing code. 

I haven't had the time to pull everything apart to try and work out what is different and it seems totally unreasonable to have to do so for what is clearly a bug that should have been fixed by now. Investing time and effort into getting a non-current version of a library is a waste of resource.

Version 3.2 of the API is currently deprecated and will be sunset 31st August so they are running out of time to actually fix this.