Google Groups Home
Help | Sign in
Discussions > Google webmaster tools > robots.txt unreachable yet it has been OK for years
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  4 messages - Collapse all
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
silverstall  
View profile
 More options Sep 27 2007, 2:45 pm
From: silverstall
Date: Thu, 27 Sep 2007 11:45:27 -0700
Local: Thurs, Sep 27 2007 2:45 pm
Subject: robots.txt unreachable yet it has been OK for years
For years http://www.amberstall.com has used the same robots.txt
without any issues. It has not changed since Nixon was president yet
for some reason webmaster tools is declaring it as unreachable. The
console states it was last calculated on the 19th Spetember 2007.
(Apoligies if there are other threads on the same subjetc but i can't
seem to trace them)

    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile
(1 user)  More options Sep 27 2007, 4:44 pm
From: cristina
Date: Thu, 27 Sep 2007 20:44:48 -0000
Local: Thurs, Sep 27 2007 4:44 pm
Subject: Re: robots.txt unreachable yet it has been OK for years
Where do you get this error message?
Did you look at the robots.txt analysis page
in the Tools of Google Webmaster Tools
and at your server access logs and error logs?

Cristina.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Susan Moskwa Google employee  
View profile
(1 user)  More options Sep 27 2007, 4:46 pm
From: Susan Moskwa
Date: Thu, 27 Sep 2007 20:46:30 -0000
Local: Thurs, Sep 27 2007 4:46 pm
Subject: Re: robots.txt unreachable yet it has been OK for years
Hi silverstall--

A search for [cache:www.amberstall.com] shows that your homepage was
last cached on 22 September, so it looks like we've been able to
access it since the error was reported. The Googlebot may have just
stopped by during a momentary error on the 19th, but then come back on
the 22nd and been able to access your site and robots.txt file without
problems. To verify that this is the case, you could look at the
robots.txt analysis tool in webmaster tools to see if it reports a
"Last downloaded" date more recent than the 19th. If so, everything
should be fine and it may just take awhile for that error to disappear
from your "Web crawl" list.

If you're still concerned about it, keep an eye on the "Last
Calculated" date of the error you're seeing and feel free to post back
here if it becomes more recent.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
silverstall  
View profile
 More options Sep 27 2007, 8:49 pm
From: silverstall
Date: Thu, 27 Sep 2007 17:49:58 -0700
Local: Thurs, Sep 27 2007 8:49 pm
Subject: Re: robots.txt unreachable yet it has been OK for years
Hi Christina - the error appears in the "Unreachable URLs" of
webmaster tools.

Hi Susan - the robots.txt analysis does confirm that it was last
downloaded on the 27th sept. without problems - (sorry i did not think
of checking that tool - distracted by US ladies football team being
cheated by Brazil). The error message is still there however as you
say it ought to disappear over time.

Many thanks to both of you for your kind support.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2008 Google