Googlebot Spawning New Instances

Showing 1-3 of 3 messages
Googlebot Spawning New Instances Jeff Deskins 9/1/11 1:43 PM
Thought it was funny that while I was looking at ways to keep the cost down in App Engine - Googlebot started crawling the site at a rate of up to 12 pages per second.  This caused another 6 instances to be created!

Jeff

Re: Googlebot Spawning New Instances zdravko 9/1/11 1:47 PM
Imagine how busy it could get during a GOOG quarter end that is with
lower than expected revenues.
Re: Googlebot Spawning New Instances Santiago Lema 9/1/11 3:31 PM
If they keep doing this often enough to keep the instances up it might
be a worthy business model!
6 instances * 0.08  *24 hours *30 days = 345 USD / month.