Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Discussions > Random chit-chat > Why are googlebots trying to crawl a non-existent computer?
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  3 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
DaveAtFraud  
View profile  
 More options Oct 19 2008, 6:08 pm
From: DaveAtFraud
Date: Sun, 19 Oct 2008 15:08:03 -0700 (PDT)
Local: Sun, Oct 19 2008 6:08 pm
Subject: Why are googlebots trying to crawl a non-existent computer?
On a fairly regular basis, I see something like the following in my
DNS log:

    client 66.249.67.100 query 'fubar.local.davenjudy.org/A/IN'
denied: 1 Time(s)
    client 66.249.67.168 query 'fubar.local.davenjudy.org/A/IN'
denied: 1 Time(s)
    client 66.249.70.162 query 'fubar.local.davenjudy.org/A/IN'
denied: 2 Time(s)
    client 66.249.70.228 query 'fubar.local.davenjudy.org/A/IN'
denied: 1 Time(s)
    client 66.249.70.232 query 'fubar.local.davenjudy.org/A/IN'
denied: 2 Time(s)
    client 66.249.73.111 query 'fubar.local.davenjudy.org/A/IN'
denied: 2 Time(s)
    client 66.249.73.188 query 'fubar.local.davenjudy.org/A/IN'
denied: 1 Time(s)
    client 66.249.73.65 query 'fubar.local.davenjudy.org/A/IN' denied:
1 Time(s)
    client 66.249.73.67 query 'fubar.local.davenjudy.org/A/IN' denied:
1 Time(s)

I have several other internal systems (local.davenjudy.org is my
internal network) that googlebots don't attempt to crawl.  None of the
systems get crawled since they are not resolvable outside of my local
network.  fubar was what I originally called my laptop until I re-
installed a year or more ago so it doesn't even exist anymore.  Just
wondering why googlebots are still interested in it and none of the
others.

Cheers,
Dave


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Oct 19 2008, 7:01 pm
From: webado
Date: Sun, 19 Oct 2008 16:01:59 -0700 (PDT)
Local: Sun, Oct 19 2008 7:01 pm
Subject: Re: Why are googlebots trying to crawl a non-existent computer?
http://www.intodns.com/davenjudy.org

That shows there exists a domain called davenjudy.org and it's got 2
nameservers (though one's lame), and all the others are subdomains on
thsi domain.

The way I see it is out on the web there must exist cached links to
the subdomain you once had. Googlebot is tryung to access it, and
first comes the dns lookup .

I can even successfully ping that subdomain:

Microsoft Windows XP [Version 5.1.2600]
(C) Copyright 1985-2001 Microsoft Corp.

C:\Documents and Settings\Christina>ping fubar.local.davenjudy.org

Pinging fubar.local.davenjudy.org [67.215.66.132] with 32 bytes of
data:

Reply from 67.215.66.132: bytes=32 time=112ms TTL=51
Reply from 67.215.66.132: bytes=32 time=101ms TTL=51
Reply from 67.215.66.132: bytes=32 time=104ms TTL=51
Reply from 67.215.66.132: bytes=32 time=105ms TTL=51

Ping statistics for 67.215.66.132:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 101ms, Maximum = 112ms, Average = 105ms

So bottom lie: for Googlebto it exists therefore it will try to access
it.

On Oct 19, 6:08 pm, DaveAtFraud wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JohnMu Google employee  
View profile  
 More options Oct 20 2008, 3:10 am
From: JohnMu
Date: Mon, 20 Oct 2008 00:10:48 -0700 (PDT)
Local: Mon, Oct 20 2008 3:10 am
Subject: Re: Why are googlebots trying to crawl a non-existent computer?
Hi Dave and welcome to the groups!

In general, these types of attempts are due to us finding a link to
the domain somewhere. Searching for your host name, I noticed that
there are some pages where links exist (for instance on
http://markmail.org/message/zwyqukrkgffp3bqb ). When we find links,
we'll try to follow them just in case there is something that is
crawlable :). In your case, we aren't able to resolve DNS for the host
name, so we leave it at that.

Hope it helps!
John


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google