Commercial use of Google API (without getting CAPTCHAs)

[naga]

Hello,

Within the confines of our alerting service ( http://www.trackle.com/
), our back-end implementation requires querying Google periodically
for every keyword users have ever registered with us. This means --
sending automated queries over to Google to fetch search results. We
are just getting started and we are already noticing that we are
getting CAPTCHAs in response (probably because we are hammering the
service a bit much). Is there any recommended way to avoid running
into this?

In fact, we are willing to pay a licensing fee in order to have
unrestricted access to AJAX API. We looked at the recenly released
Google Custom Search Engine business edition, however the problem is
that they don't allow us to query the entire web.

I'd appreciate any suggestions.

Thank you.
--
Naga.

[Jeremy Geerdes]

Unfortunately, I really doubt that you'll get a response from Google.
The truth is that they specifically designed the Search API and its
TOS so that you could not do what you have described. From their
perspective, the ability to manipulate your own search engine
placement by testing wording and such defeats the purpose of the
entire search engine. They want to find results that are really
relevant, not results that have been engineered to look relevant. To
that end, they have designed the API to return only up to 64 results,
in 8 separate requests. And they have included specific clauses in the
TOS to prohibit the use of automated queries and such. Sorry to be the
bearer of bad news.

Jeremy R. Geerdes
Effective website design & development
Des Moines, IA

For more information or a project quote:
http://jgeerdes.home.mchsi.com
http://jgeerdes.blogspot.com
http://jgeerdes.wordpress.com
jgee...@mchsi.com

Unless otherwise noted, any price quotes contained within this
communication are given in US dollars.

If you're in the Des Moines, IA, area, check out Debra Heights
Wesleyan Church!

And check out my blog, Adventures in Web Development, at http://jgeerdes.blogspot.com
!