Google Groups Home
Help | Sign in
Strange Geocoder Behavior
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  11 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
maps.huge.info  
View profile  
 More options Jun 20 2006, 10:30 pm
From: "maps.huge.info" <cor...@gmail.com>
Date: Wed, 21 Jun 2006 02:30:55 -0000
Local: Tues, Jun 20 2006 10:30 pm
Subject: Strange Geocoder Behavior
I've been processing geocoder requests at the rate of 1.7 per second
and after 30,000 or so requests I'm getting 403 Forbidden responses.

What's the story here? Joel? Got any answers? I am playing totally by
the rules. I should be able to get 50,000 requests per day, right?

-John

http://maps.huge.info


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bo  
View profile  
 More options Jun 20 2006, 11:53 pm
From: "Bo" <zorg...@gmail.com>
Date: Wed, 21 Jun 2006 03:53:34 -0000
Local: Tues, Jun 20 2006 11:53 pm
Subject: Re: Strange Geocoder Behavior
John,

At the moment our servers are very sensitive. The actual rate should be
one query per 1.725s. This results in about 800 addresses less per day,
or 1.6%. Pretty insignificant, yet detected by our software. My
apologies for inconvenience at these early stages when we are gathering
data and fine-tuning our geocoding API.


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
maps.huge.info  
View profile  
 More options Jun 21 2006, 12:46 am
From: "maps.huge.info" <cor...@gmail.com>
Date: Wed, 21 Jun 2006 04:46:54 -0000
Local: Wed, Jun 21 2006 12:46 am
Subject: Re: Strange Geocoder Behavior
Bo,

Jeez, I guess your geocoder must be female... so sensitive. I'll adjust
my program accordingly.

-John

http://maps.huge.info


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bo  
View profile  
 More options Jun 21 2006, 3:56 am
From: "Bo" <zorg...@gmail.com>
Date: Wed, 21 Jun 2006 07:56:12 -0000
Local: Wed, Jun 21 2006 3:56 am
Subject: Re: Strange Geocoder Behavior
Ah well, if "she" gives you any more troubles, let us know. We sure
appreciate all feedback!

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
maps.huge.info  
View profile  
 More options Jun 21 2006, 10:22 am
From: "maps.huge.info" <cor...@gmail.com>
Date: Wed, 21 Jun 2006 14:22:54 -0000
Local: Wed, Jun 21 2006 10:22 am
Subject: Re: Strange Geocoder Behavior
Bo,

Working fine now. I gave it an extra 1/10th (1.8 seconds) second just
for fun.

-John

http://maps.huge.info


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Louis  
View profile  
 More options Jun 21 2006, 9:42 pm
From: "Louis" <tarh...@gmail.com>
Date: Thu, 22 Jun 2006 01:42:31 -0000
Local: Wed, Jun 21 2006 9:42 pm
Subject: Re: Strange Geocoder Behavior
Bo,

I'm confused about two things:

1. One query per 1.725 seconds = 50,086 per day, so I'm not sure what
you mean when you say that this results in 800 fewer geocodes.

2. Do you mean that we should always wait 1.725 seconds between queries
to your server or just that we should average that rate over the course
of a day?

Thanks,
Louis


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bo  
View profile  
(3 users)  More options Jun 21 2006, 10:31 pm
From: "Bo" <zorg...@gmail.com>
Date: Thu, 22 Jun 2006 02:31:42 -0000
Local: Wed, Jun 21 2006 10:31 pm
Subject: Re: Strange Geocoder Behavior

> 1. One query per 1.725 seconds = 50,086 per day, so I'm not sure what
> you mean when you say that this results in 800 fewer geocodes.

If you were to send us an address every 1.7s, you would send 50823
rather than 50,086 queries per day. The difference is around 800 ... or
more like 737

> 2. Do you mean that we should always wait 1.725 seconds between queries
> to your server or just that we should average that rate over the course
> of a day?

This is average rate. If you have a site that uses geocoder, it may
happen that a number of visitors will generate a burst of traffic. We
allow for that. However, as others noted, after a several hundred
addresses, we start paying closer attention. This needs to be
documented properly. My apologies for not making it clearer in the
documentation or FAQ. We are working on it.

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
maps.huge.info  
View profile  
 More options Jun 21 2006, 11:18 pm
From: "maps.huge.info" <cor...@gmail.com>
Date: Thu, 22 Jun 2006 03:18:04 -0000
Local: Wed, Jun 21 2006 11:18 pm
Subject: Re: Strange Geocoder Behavior
Louis,

I believe that if you are doing batch geocoding, you should put a delay
into your program of the 1.725 seconds or you will get the 403
Forbidden code after about 1000 or so hits, as Bo indicates.

As for use on a website, this limit would cause the geocoder to not be
as useful using the API. On the other hand, Bo and friends want us
(strongly) to cache our results, so perhaps it's best to redirect these
geocode requests to a server based program that can put in the required
wait or retrieve a previously coded result without hitting Google.

-John

http://maps.huge.info


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Neil  
View profile  
 More options Jun 22 2006, 3:35 pm
From: "Neil" <NeilCMered...@gmail.com>
Date: Thu, 22 Jun 2006 19:35:40 -0000
Local: Thurs, Jun 22 2006 3:35 pm
Subject: Re: Strange Geocoder Behavior
I had the same problem as John, and it happened to me even sooner
(after only 5,000 queries) since  I wasn't regulating the speed of my
geocoder requests (I was sending about 5 requests a second).

I am still receiving the 403 forbidden responses hours later.  Do you
know how long it takes before that gets reset and I can try again?
I'll slow down the requests this time, I promise!


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
maps.huge.info  
View profile  
 More options Jun 22 2006, 8:00 pm
From: "maps.huge.info" <cor...@gmail.com>
Date: Fri, 23 Jun 2006 00:00:07 -0000
Local: Thurs, Jun 22 2006 8:00 pm
Subject: Re: Strange Geocoder Behavior
Neil,

I waited until I got an answer, which was the next day, so maybe you
need 12 hours or more to clear the buffer.

If you keep your requests to 1 every 1.725 seconds (I'm using 1.75 to
be safe) you will be fine. I use the hi-res timer in Perl to do it and
it works great.

-John

http://maps.huge.info


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Neil  
View profile  
 More options Jun 26 2006, 9:25 am
From: "Neil" <NeilCMered...@gmail.com>
Date: Mon, 26 Jun 2006 13:25:59 -0000
Local: Mon, Jun 26 2006 9:25 am
Subject: Re: Strange Geocoder Behavior
Thanks for the response John - you're right, I waited until the next
day and upped the request time, and everything is working just fine
now.

Neil


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google