Account Options

  1. Sign in
The old Google Groups will be going away soon.
Switch to the new Google Groups.
Google Groups Home
« Groups Home
Google Webmaster Help
Home
About this group
Join this group
Discussions > Crawling, indexing, and ranking > Network unreachable error - Please help!
Options
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
   10 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
sunyopt  
View profile  
 More options Jul 14 2008, 11:36 am
From: sunyopt
Date: Mon, 14 Jul 2008 08:36:33 -0700 (PDT)
Local: Mon, Jul 14 2008 11:36 am
Subject: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
The robots.txt works fine however Google's crawlers still have problem
while accessing our website.

See below

robots.txt URL  http://www.sunyopt.edu/robots.txt
Last downloaded         Jul 11, 2008
Status  200 (Success) Help Help

unreachable URLs (194)

Unreachable URLs
1 – 25 of 194 Next ›
URL     Detail  Last Calculated
http://www.sunyopt.edu/      Network unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/HR/index.shtml  robots.txt unreachableHelp Help
        Jul 7, 2008
http://www.sunyopt.edu/HR/jobs.shtml    robots.txt unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/IT/EMR.swf  Network unreachableHelp Help
        Jul 2, 2008
http://www.sunyopt.edu/IT/EMRstu.swf    Network unreachableHelp Help
        Jul 2, 2008
http://www.sunyopt.edu/about/A-Z.shtml        robots.txt unreachableHelp
Help
        Jul 7, 2008
http://www.sunyopt.edu/about/about.shtml    Network unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/about/clinsci.shtml        robots.txt unreachableHelp
Help
        Jun 28, 2008
http://www.sunyopt.edu/about/index.shtml    robots.txt unreachableHelp
Help
        Jul 1, 2008
http://www.sunyopt.edu/academics/Vision_at_a_Glance.pdf      robots.txt
unreachableHelp Help
        Jul 8, 2008
http://www.sunyopt.edu/academics/academics.shtml    robots.txt
unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/academics/clinsci.shtml        Network
unreachableHelp Help
        Jul 5, 2008
http://www.sunyopt.edu/academics/curriculum.shtml  robots.txt
unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/academics/grad.shtml      robots.txt
unreachableHelp Help
        Jul 9, 2008
http://www.sunyopt.edu/academics/grad_mba.shtml      robots.txt
unreachableHelp Help
        Jul 2, 2008
http://www.sunyopt.edu/academics/index.shtml    robots.txt
unreachableHelp Help
        Jul 9, 2008
http://www.sunyopt.edu/academics/jsher...s/Seasickness_YosefTekeste_F...
Network unreachableHelp Help
        Jul 5, 2008
http://www.sunyopt.edu/academics/od_curriculum.shtml    robots.txt
unreachableHelp Help
        Jul 1, 2008
http://www.sunyopt.edu/academics/res_descript.shtml      Network
unreachableHelp Help
        Jul 5, 2008
http://www.sunyopt.edu/academics/residency.shtml    robots.txt
unreachableHelp Help
        Jun 30, 2008
http://www.sunyopt.edu/academics/sched.shtml    robots.txt
unreachableHelp Help
        Jul 10, 2008
http://www.sunyopt.edu/admissions/application.shtml      robots.txt
unreachableHelp Help
        Jun 27, 2008
http://www.sunyopt.edu/admissions/dates.shtml  robots.txt
unreachableHelp Help
        Jun 27, 2008
http://www.sunyopt.edu/admissions/demograph.shtml  robots.txt
unreachableHelp Help
        Jun 27, 2008
http://www.sunyopt.edu/admissions/finaid.shtml        robots.txt
unreachableHelp Help
        Jul 10, 2008
...


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile  
 More options Jul 14 2008, 11:55 am
From: cristina
Date: Mon, 14 Jul 2008 08:55:41 -0700 (PDT)
Local: Mon, Jul 14 2008 11:55 am
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Did you submit a sitemap for your site?
If so, just in case the network unreachable
was a temporary problem,
can you resubmit the sitemap?

Cristina.

On Jul 14, 4:36 pm, sunyopt wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Autocrat  
View profile  
 More options Jul 14 2008, 11:58 am
From: Autocrat
Date: Mon, 14 Jul 2008 08:58:31 -0700 (PDT)
Local: Mon, Jul 14 2008 11:58 am
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Okay...

are you concerned about the Errors, or the fact that it keeps saying
unreachable?

.

Some of those URLs don't exist
(http://www.sunyopt.edu/admissions/finaid.shtml)

.

Maybe you are having server issues?
Can you check your logs and see if there was a problem whilst G tried
to crawl it?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
lots0  
View profile  
 More options Jul 14 2008, 11:58 am
From: lots0
Date: Mon, 14 Jul 2008 08:58:48 -0700 (PDT)
Local: Mon, Jul 14 2008 11:58 am
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
It would appear that googlebot does have a problem with your
robots.txt.

have you used the robots.txt verifier in the webmaster tools?

On Jul 14, 9:36 am, sunyopt wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
sunyopt  
View profile  
 More options Jul 14 2008, 12:07 pm
From: sunyopt
Date: Mon, 14 Jul 2008 09:07:48 -0700 (PDT)
Local: Mon, Jul 14 2008 12:07 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
I tried to submit a sitemap many times but it gave me the following
Sitemap errors and warnings

Details         -       Network unreachable: robots.txt unreachable
We were unable to crawl your Sitemap because we found a robots.txt
file at the root of your site but were unable to download it. Please
ensure that it is accessible or remove it completely.

On Jul 14, 11:55 am, cristina wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
sunyopt  
View profile  
 More options Jul 14 2008, 12:10 pm
From: sunyopt
Date: Mon, 14 Jul 2008 09:10:46 -0700 (PDT)
Local: Mon, Jul 14 2008 12:10 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Are you talking about the "Analyze robots.txt" under Tools?

It shows
robots.txt URL  http://www.sunyopt.edu/robots.txt
Last downloaded         Jul 11, 2008
Status  200 (Success)

On Jul 14, 11:58 am, lots0 wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
sunyopt  
View profile  
 More options Jul 14 2008, 12:16 pm
From: sunyopt
Date: Mon, 14 Jul 2008 09:16:08 -0700 (PDT)
Local: Mon, Jul 14 2008 12:16 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Our concern is that Googlebot cannot reach us. Doing a search using
"suny optometry" on google, the search result only shows our index
page while it shows many of other pages before. What can we do to fix
the network issue so google can crawl the entire website?

On Jul 14, 11:58 am, Autocrat wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile  
 More options Jul 14 2008, 12:18 pm
From: cristina
Date: Mon, 14 Jul 2008 09:18:57 -0700 (PDT)
Local: Mon, Jul 14 2008 12:18 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Check if your site is blocking Googlebot
in any way, via .htaccess or firewall, etc.

Cristina.

On Jul 14, 5:16 pm, sunyopt wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JLH  
View profile  
 More options Jul 14 2008, 12:32 pm
From: JLH
Date: Mon, 14 Jul 2008 09:32:08 -0700 (PDT)
Local: Mon, Jul 14 2008 12:32 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
It's more than likely an issue on the server not accepting Google's
attempts to reach the robots.txt periodically.  I cannot replicate it
right now, tried it several times bot with a Google IP and useragent,
no referer, no java enabled etc.  The site appears to be on a
dedicated server, or at least not a very populated one so I'd work
through the logs on the dates given above when they could not reach
robots.txt and see if anything sticks out, high load, server down,
etc.

It could hurt you if you don't figure out what is causing Google to
not be able to reach the server, it seems to be sporadic which is kind
of weird.  I don't know your hosting situation but if done through a
3rd party, I'd get them involved and tell them that Googlebot is
having trouble reaching the site.  Perhaps they have some sort of
robot trap running for over-agressive bots that Google got caught up
in.

Perhaps a Googler can look into the exact response a bit more, but
like I said I cannot replicate the errors at the moment.

On Jul 14, 11:16 am, sunyopt wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JohnMu Google employee  
View profile  
 More options Jul 20 2008, 6:41 pm
From: JohnMu
Date: Sun, 20 Jul 2008 15:41:08 -0700 (PDT)
Local: Sun, Jul 20 2008 6:41 pm
Subject: Re: Network unreachable error - Please help!
Print | Individual message | Report this message | Find messages by this author
Hi sunyopt and welcome to the groups!

JLH is pretty much spot-on, it does look like the Googlebot is having
trouble reaching your site in general. It would be good to check with
whoever is responsible for the hosting to make sure that there is
nothing blocking the Googlebot's access.

Hope it helps!
John


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2012 Google