Structure Report exceeds 250MB limit - what now?

[crozzer]

My Structure Reports are getting truncated at the 250MB limit.
Is it possible to get an exception on the limit, even if for structure
reports only?

My only alternative would be to iterate through all accounts,
campaigns, adgroups, and criterion, which is A LOT of API units and
extra traffic...

Any other ideas?

MCC: 290-087-1247
CID: 938-333-7070 (example)

[AdWords API Advisor]

Hello,

(As a preface, I'm hampered when discussing this issue by the fact
that I don't have access to an account large enough for this to be an
issue, so I haven't been able to test this behavior myself.)

Are you seeing the same truncation when you download the report as a
GZip file? If so, what exactly are you able to download: a GZip file
whose compressed size is 250mb? Or a GZip file whose uncompressed size
is 250mb?

Cheers,
-Jeff Posnick, AdWords API Team

[crozzer]

I assumed you would be able to access my MCC and CID?

I'm re-running the reports now, and will attempt to download them via
browser and post the results later today.

[Materie]

Hi crozzer,

I recently posted a question at this forum, apperently an error in the
adwords api copies the campaign and its contents in the structure
report for each mutation to the campaign. This way my structure
reports grew to about 750 mb. I guess there may well be a 1 Gb limit,
but for now, it seems your reports are not reaching any limits.

Besides, using the api to load your structure sounds unfeasable
(unless you have a lot of money you need to get rid of quickly).

Greetings,

Koen Lavooij

[LeTic]

Hey guys,

As far as I can remember at the time we checked, the gzip was also
limited at 250 Mb uncompressed. There already was some discussion on
this matter :
http://groups.google.com/group/adwords-api/msg/2d5f8cc9e5664bc6?hl=en -
> confirmed that the gzip limit is on the file size its contains.
http://groups.google.com/group/adwords-api/msg/b10ccee434ae8b9b?hl=en

Things might have change since these message and since we tested it as
well (must have been a couple of years). Could you confirm this
crozzer ?

Cheers
LeTic

[AdWords API Advisor]

Yes, I was able to access the report in question given the information
about your client's ID, but my method of downloading the report isn't
functionally identical to how you would download the report via the
API. Personally, I was able to retrieve a GZip-ed version of your
report that came in at well under 250mb, and when it was uncompressed
it was around 2gb. (Say what you will about incredibly repetitive XML
structures, but they compress nicely).

I never get very far when I try to figure out exactly what the current
state of this behavior is because a) the limitation is not entirely
intentional on our part and b) I don't have a good way of simulating
exactly what you're seeing with a report of that size. So I'm hoping
that if you can easily schedule a report that large and then attempt
to download the report by retrieving the URL for the GZip file from
the API (and then downloading it from your browser or your code or
whatnot), then that would be a good test as to the current behavior.

Cheers,
-Jeff Posnick, AdWords API Team

On Nov 17, 4:43 am, LeTic <cally...@gmail.com> wrote:
> Hey guys,
>
> As far as I can remember at the time we checked, the gzip was also
> limited at 250 Mb uncompressed. There already was some discussion on

> this matter :http://groups.google.com/group/adwords-api/msg/2d5f8cc9e5664bc6?hl=en-> confirmed that the gzip limit is on the file size its contains.

[crozzer]

Indeed, I'm able to download the report as a gzip.
For the record, it was 50MB compressed (and downloaded), 3 GB
uncompressed.
So, indeed, it looks as if the 250MB limit applies to the download
size, NOT the uncompressed size.

[AdWords API Advisor]

Hello,

Great, I'm glad to hear that confirmed from a developer "out in the
wild".

So if you're concerned about your reports possibly being too large
and getting truncated when downloaded, it sounds like the best
practice is to always request the GZip-ed version. Given how
compressible the reports are, I'd think that any GZip file that gets
to be over 250mb would translate into an XML file that would be
unfeasible to parse in a reasonable manner in the first place.

Cheers,
-Jeff Posnick, AdWords API Team

[crozzer]

Hi Jeff,
A solid suggestion. We'll incorporate that eventually.
Unfortunately something as simple as gzipFile.Uncompress() is only a
dream in .NET...
Thanks,
~Crosby

[AdWords API Advisor]

Hello Crosby,

True, but there's the GPL-ed zpilib project that should be easy to
incorporate into your code:

http://sharpdevelop.net/OpenSource/SharpZipLib/Default.aspx

(There are probably other libraries as well...)

Cheers,
-Jeff Posnick, AdWords API Team

[Zweitze]

Do you use .NET 2.0 or higher?
Use System.Io.Compression.GZipStream. Very easy, just like a normal
stream.

(On a side note, my software recently downloaded a 1.1 GB Creative
report. Compressed it was about 40 MB)

[crozzer]

Hey, thanks Zweitze, not sure how I missed that.