Groups keyboard shortcuts have been updated
Dismiss
See shortcuts

Would it be even reasonable to fetch 100 to 1000 URLs at once?

216 views
Skip to first unread message

ChiefChippy2

unread,
Oct 12, 2019, 3:23:05 AM10/12/19
to Google Apps Script Community
I am creating a project for personal use, and I would need to fetch similar URLs ( but never identical ) 100 to 1000 times instantly. They are all from the same domain, but different path by the way.
Now my concerns are : 
1. How long would it take ( with UrlFetchApp.fetchall() )
2. Would I get blocked by the site for too much network requests?
3. Will this actually use up my quota for urlfetchapp calls if I call it too much times?

Monique Szpak

unread,
Oct 12, 2019, 5:52:47 AM10/12/19
to Google Apps Script Community
1. Some info about fetchall including benchmarks and code... https://gist.github.com/tanaikech/c0f383034045ab63c19604139ecb0728
2. Depends on the site
3. URL Fetch calls limit is 20,000/day according to the list of service quotas: https://developers.google.com/apps-script/guides/services/quotas
Reply all
Reply to author
Forward
0 new messages