Would it be even reasonable to fetch 100 to 1000 URLs at once?

186 views
Skip to first unread message

ChiefChippy2

unread,
Oct 12, 2019, 3:23:05 AM10/12/19
to Google Apps Script Community
I am creating a project for personal use, and I would need to fetch similar URLs ( but never identical ) 100 to 1000 times instantly. They are all from the same domain, but different path by the way.
Now my concerns are : 
1. How long would it take ( with UrlFetchApp.fetchall() )
2. Would I get blocked by the site for too much network requests?
3. Will this actually use up my quota for urlfetchapp calls if I call it too much times?

Monique Szpak

unread,
Oct 12, 2019, 5:52:47 AM10/12/19
to Google Apps Script Community
1. Some info about fetchall including benchmarks and code... https://gist.github.com/tanaikech/c0f383034045ab63c19604139ecb0728
2. Depends on the site
3. URL Fetch calls limit is 20,000/day according to the list of service quotas: https://developers.google.com/apps-script/guides/services/quotas
Reply all
Reply to author
Forward
0 new messages