Curious about changes to Apps Script Quotas

[dimud...@gmail.com]

I've been reviewing the current quotas page and comparing it against past quota limits from a sample page from chapter 4 of Bruce Mcpherson's Going GAS.

I noticed that the UrlFetch Data Received quota (100MB) present on that sample page is now conspicuously absent from the Apps Script reference documentation.

I haven't tested it yet, but I'm curious to know if we are still bound by that 100MB limit. Has it been increased, or better yet, has it been removed entirely?

[Clay Smith]

As of 3 weeks ago I was still facing the 100mb limit. I was sending data for a data studio connector and tuned some pagination to accommodate. I’ll give ago at expanding to see if anything has changed. 

Clay

On Feb 18, 2021, at 19:59, dimud...@gmail.com <dimud...@gmail.com> wrote:

I've been reviewing the current quotas page and comparing it against past quota limits from a sample page from chapter 4 of Bruce Mcpherson's Going GAS.

I noticed that the UrlFetch Data Received quota (100MB) present on that sample page is now conspicuously absent from the Apps Script reference documentation.

I haven't tested it yet, but I'm curious to know if we are still bound by that 100MB limit. Has it been increased, or better yet, has it been removed entirely?

--
You received this message because you are subscribed to the Google Groups "Google Apps Script Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-apps-script-c...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-apps-script-community/1b397b58-b6d3-4b5a-84a9-c79ac9b2aee2n%40googlegroups.com.

[dimud...@gmail.com]

The quotas page was last updated 2021-02-11...so that's around a week ago. Google might have changed something...only way to find out is to test it for ourselves it seems. 

[Tanaike]

In the current stage, when the file more than the size of 50 MB is downloaded using UrlFetchApp, the retrieved data of file from "UrlFetchApp.fetch(url).getContent().length" is 52,428,102. The 50 MB is 52,428,800. So I think that the remaining might be the response header.

[dimud...@gmail.com]

@Tanaike You're referring to the maximum amount of data that can be downloaded in a single request. What I'm curious about is the max daily download; so basically what is the maximum amount you can cumulatively download in a day. In the past this was listed as 'UrlFetch Data Received' under daily quotas, but it seems to have been removed from the quotas page. So we're left with the question - Is this quota still in effect or not?

[Tanaike]

Thank you for replying. I deeply apologize for my poor English skill. I couldn't notice about "the max daily download".

For example, for above testing, I tested continuously 5 times. In this case, total downloaded size is 262,140,510 bytes. And, now I tested one more time. But no error occurs. Unfortunately, now, I have no information about the maximum total downloaded size for one day yet. I apologize for this.

[dimud...@gmail.com]

@Tanaike: There is absolutely no need for you to apologize on either count. I was just clarifying my intent. Thank you for running those tests. Based on your results thus far it appears the quota has been increased (maybe even removed). That's some very valuable information. If anything you have my gratitude for taking the time to investigate. Thanks again.

[Bruce Mcpherson]

I believe about 2 years ago the daily limit was relaxed (or even  removed) but the size of transfer was still in place. Possibly around the time that urlfetchapp.fetchAll was introduced. I remember doing some tests on this but I can't find the write up I did. 

@Romain Vialard is usually on top of these things - Romain.. do you remember the details or the release notes?

--
You received this message because you are subscribed to the Google Groups "Google Apps Script Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-apps-script-c...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-apps-script-community/459fb1ce-ebae-4d08-9946-a93db50c5678n%40googlegroups.com.

[Romain Vialard]

Google Apps Script Release Notes are public, which is a really good thing!

June 19, 2018:

The quota limits for UrlFetch GET response size and POST size have been increased to 50MB / call. The quota on total data received by UrlFetch per day per user has been removed.

https://developers.google.com/apps-script/releases/2018#june_19_2018

The 100Mb limit was the daily limit removed in 2018.

The previous limit per call was 25MB (instead of 50MB).

[dimud...@gmail.com]

@Romain: Well now I feel dumb. I'm aware of the release notes, but just never thought to check it.

[dimud...@gmail.com]

Thanks for the help with the question folks. While I have your attention I have another limit-related question. Is there a limit on the size of a script file added to an Apps Script project?

[dimud...@gmail.com]

Best I could find in the release notes is the entry listed below:

https://developers.google.com/apps-script/releases/2011#march_2011

It states that the script editor "can now handle large scripts without any issues in most major browsers" but that's not exactly specific. I've fallen into the habit of leveraging several beefy NPM modules in a single project. The new editor seems to be holding up well so far but it would be great to know before-hand of any possible upper-bounds on code size.

[Tanaike]

Thank you for replying. Although I'm not sure whether this is the useful information, now, I remembered about my repository of DownloadLargeFilesByUrl.  In this repository, I had written as follows.

Quotes of URL Fetch response size and URL Fetch POST size became from 100 MB/day to 50 MB/call.

By this, I had thought that the limitation of 100 MB/day was released. So I created this method.