> I haven't seen a similar issue posted here in the groups.
http://groups.google.com/group/Google_Webmaster_Help/search?group=Goo... It's a common problem. It is NOT malformed URIs on the site or indeed
on any other site - if that were the case, other search engine bots
would try to find them too.
It's exclusively a Googlebot problem, and it's been around for at
least two years and possibly longer. The solution is entirely within
Google's purview - just analyse a few thousand of your 404 responses
and try to work out where you got the URI from. Do Google's systems
have no audit trails?
Some of these things are flat ridiculous and make Google look really
stupid. About six months ago, the Googlebot tried to download every
URI on my site, but substituting .asp for all of my .html files. What
bolleaux! No other bot has ever done this. And I've never had a .asp
page on the site.
It seems stupifying. It happens on all my sites - why doesn't Google
put up a simple site and see what happens? Or check Matt Cutts'
server logs?