Google has found a new way to confuse things and demonstrate their data processing problems. This has been going on for several months now.
I'm getting the following error message at erratic times:
URLs not followed When we tested a sample of the URLs from your Sitemap, we found that some URLs were not accessible to Googlebot because they contained too many redirects. Please change the URLs in your Sitemap that redirect and replace them with the destination URL (the redirect target). All valid URLs will still be submitted.
It sometimes cites a URL that is not in the site map and the page is a single "Refresh" redirect. All of the others it fusses about are a single ASP redirect.
Resubmitting the SiteMap.txt file seems to clear the errors and then within a week they crop up on other sites I monitor.
> Google has found a new way to confuse things and demonstrate their > data processing problems. This has been going on for several months > now.
> I'm getting the following error message at erratic times:
> URLs not followed > When we tested a sample of the URLs from your Sitemap, we found that > some URLs were not accessible to Googlebot because they contained too > many redirects. Please change the URLs in your Sitemap that redirect > and replace them with the destination URL (the redirect target). All > valid URLs will still be submitted.
> It sometimes cites a URL that is not in the site map and the page is a > single "Refresh" redirect. All of the others it fusses about are a > single ASP redirect.
> Resubmitting the SiteMap.txt file seems to clear the errors and then > within a week they crop up on other sites I monitor.
Well it seems to me this has been said so many times it must be falling on deaf ears.
Run Xenu - if you find even one redirection past the entry point to the site where you may have one single 302 (that's when the site's actual homepage and rest of contents are installed in a folder as happens unfortunately by default with some canned software like CMS, e- commerce, etc) , then you must fix all your navigation so it will not require any redirections at all at any point. And all this is in addition to being fully consistent in your navigation as far as which canonical domain form you are using.
> If your sitemap or any navigation links on your site constantly > require the use of redirects, you will keep getting that error.
> Redirects should not be part of normal navigation as it is a waste of > resources on both ends, client and server.
> In the past, Google didn't check redirects, now it does.
> So, not data processing problems, maybe website management > problems? ;-)
> Craig
> On Sep 16, 12:37 am, Chris Gunn wrote:
> > Howdy Folks,
> > Google has found a new way to confuse things and demonstrate their > > data processing problems. This has been going on for several months > > now.
> > I'm getting the following error message at erratic times:
> > URLs not followed > > When we tested a sample of the URLs from your Sitemap, we found that > > some URLs were not accessible to Googlebot because they contained too > > many redirects. Please change the URLs in your Sitemap that redirect > > and replace them with the destination URL (the redirect target). All > > valid URLs will still be submitted.
> > It sometimes cites a URL that is not in the site map and the page is a > > single "Refresh" redirect. All of the others it fusses about are a > > single ASP redirect.
> > Resubmitting the SiteMap.txt file seems to clear the errors and then > > within a week they crop up on other sites I monitor.
> If your sitemap or any navigation links on your site constantly > require the use of redirects, you will keep getting that error.
> Redirects should not be part of normal navigation as it is a waste of > resources on both ends, client and server.
Howdy,
I fully agree! However, when a home page must be assembled dynamically by server side software, a redirect is appropriate. It's also very handy when an old page needs to send people to a newer page.
The error I was fussing about states "contained too many redirects." and it should have no problem with a single one which is all that exists. Google's scripts are stuttering and handling a single redirect as multiples or is getting totally confused with data corruption.
Google's search engine software is screaming fast and performs great. Their support scripts, like the Googlebot are a disaster. The difference is the search engine runs as compiled software and the scripts run as CGI with very poor memory isolation.
> Run Xenu - if you find even one redirection past the entry point to > the site where you may have one single 302 (that's when the site's > actual homepage and rest of contents are installed in a folder as
Howdy Webado,
I read just fine. I've told you before, this Xenu was written back in the very old days with nothing but static web pages. Trying to use it on dynamic sites that track people through a site without cookies is conducting an intentional "criminal" level attack on the site.
The old Xenu does not scan a web site the way the robots do. Xenu repeatedly goes back to the home page URL for the next link instead of collecting all of the available links and using that list to move to the next level. It DOES NOT work the way the Googlebot does.
Xenu was okay years ago as a quicky hobby script but recommending it today is unethical and abusive. Please get somebody to recode it or find more appropriate software to recommend. There are also apparently various versions of Xenu by different groups of authors. You might find a better version.
> > Run Xenu - if you find even one redirection past the entry point to > > the site where you may have one single 302 (that's when the site's > > actual homepage and rest of contents are installed in a folder as
> Howdy Webado,
> I read just fine. I've told you before, this Xenu was written back in > the very old days with nothing but static web pages. Trying to use it > on dynamic sites that track people through a site without cookies is > conducting an intentional "criminal" level attack on the site.
> The old Xenu does not scan a web site the way the robots do. Xenu > repeatedly goes back to the home page URL for the next link instead of > collecting all of the available links and using that list to move to > the next level. It DOES NOT work the way the Googlebot does.
> Xenu was okay years ago as a quicky hobby script but recommending it > today is unethical and abusive. Please get somebody to recode it or > find more appropriate software to recommend. There are also > apparently various versions of Xenu by different groups of authors. > You might find a better version.