Web Images Videos Maps News Shopping Gmail more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Discussions > Crawling, indexing, and ranking > Lost Homepage in index and cache
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  Messages 1 - 25 of 64 - Collapse all  -  Translate all to Translated (View all originals)   Newer >
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
JLH  
View profile  
(4 users)  More options Sep 5 2007, 5:23 pm
From: JLH
Date: Wed, 05 Sep 2007 21:23:00 -0000
Subject: Lost Homepage in index and cache
There has been an awful lot of people coming to the group with their
entire site still indexed and cached except the home page.  This
doesn't seem like another -950, -30, MSSA conspiracy theory WMW
penalty but a real problem.

Is there a possiblity to get a Googler to at least acknowledge that
they've taken notice to the multitude of questions?

There is no where to point them to unless of course it's been
discussed on www.searchenginewebsitelandforumMOZroundtable.com, and I
haven't seen it.  If so could you tell us where you are officially
giving people guidance?


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
av8torfl  
View profile  
(2 users)  More options Sep 5 2007, 9:43 pm
From: av8torfl
Date: Wed, 05 Sep 2007 18:43:36 -0700
Local: Wed, Sep 5 2007 9:43 pm
Subject: Re: Lost Homepage in index and cache
That would certainly be nice....an acknowledgement for once....

http://www.travel-ascending.com/

On Sep 5, 5:23 pm, JLH wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JLH  
View profile  
(2 users)  More options Sep 7 2007, 2:24 am
From: JLH
Date: Fri, 07 Sep 2007 06:24:52 -0000
Local: Fri, Sep 7 2007 2:24 am
Subject: Re: Lost Homepage in index and cache
Ya just know I'll bump em if I have to.

On Sep 5, 4:23 pm, JLH wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SteveG  
View profile  
(1 user)  More options Sep 8 2007, 6:27 am
From: SteveG
Date: Sat, 08 Sep 2007 03:27:07 -0700
Local: Sat, Sep 8 2007 6:27 am
Subject: Re: Lost Homepage in index and cache
Yes -  please can someone help?  This is costing my business "big-
time" and the worst is that I have no idea why the home page index and
its cache have disappeared and so can seemingly do absolutely zip to
try resolve the problem. If Google were just to acknowledge this...I'd
wait patiently for the fix...and if they were to reply saying "nothing
wrong on their side"...at least we all could get working on what we
need to do to make our sites re-appear..

On Sep 5, 11:23 pm, JLH wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Chris Gunn  
View profile  
(4 users)  More options Sep 8 2007, 1:27 pm
From: Chris Gunn
Date: Sat, 08 Sep 2007 10:27:58 -0700
Local: Sat, Sep 8 2007 1:27 pm
Subject: Re: Lost Homepage in index and cache
On Sep 8, 4:27 am, SteveG wrote:

> Yes -  please can someone help?  This is costing my business "big-
> time" and the worst is that I have no idea why the home page index and
> its cache have disappeared and so can seemingly do absolutely zip to
> try resolve the problem. If Google were just to acknowledge this...I'd
> wait patiently for the fix...and if they were to reply saying "nothing
> wrong on their side"...at least we all could get working on what we
> need to do to make our sites re-appear..

Howdy,

I've been waiting for over two years now for Google to resolve their
problems with corrupted data and the trash their scripts generate on
their cheap overloaded Linux servers.

They are aware of it but won't spend the money to buy a commercial
grade operating system with memory isolation or add enough servers
with good load balancing to stop the memory overlaps between too many
executing scripts.

They also won't spend the money for properly qualified web designers,
much less real webmasters.

Chris


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SaraSchu  
View profile  
(1 user)  More options Sep 10 2007, 3:45 pm
From: SaraSchu
Date: Mon, 10 Sep 2007 12:45:02 -0700
Local: Mon, Sep 10 2007 3:45 pm
Subject: Re: Lost Homepage in index and cache
Time to put this back to page 1?

On Sep 8, 12:27 pm, Chris Gunn wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SaraSchu  
View profile  
(1 user)  More options Sep 13 2007, 11:04 pm
From: SaraSchu
Date: Thu, 13 Sep 2007 20:04:51 -0700
Local: Thurs, Sep 13 2007 11:04 pm
Subject: Re: Lost Homepage in index and cache
My home page is gone again.  Any hope of getting this issue on the
table again?

On Sep 10, 2:45 pm, SaraSchu wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
av8torfl  
View profile  
 More options Sep 14 2007, 7:54 am
From: av8torfl
Date: Fri, 14 Sep 2007 11:54:00 -0000
Subject: Re: Lost Homepage in index and cache
Really...

On Sep 10, 3:45 pm, SaraSchu wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
berto_s  
View profile  
 More options Sep 14 2007, 8:13 am
From: berto_s
Date: Fri, 14 Sep 2007 12:13:11 -0000
Local: Fri, Sep 14 2007 8:13 am
Subject: Re: Lost Homepage in index and cache
If you've suddenly dropped from the index, check to make sure you do
not have any key spam items that would flag Google to think that your
site is spam. One of the more common items is duplicate content. Check
to make sure you do not have sub-domains that have the exact same
content, or other pages that are running on different URLs, but
contain the same content.

That may not be the complete answer, but it's a start.

Keep in mind that once you've resolved problems on your end, it still
takes time to get re-indexed.

On Sep 8, 1:27 pm, Chris Gunn wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JLH  
View profile  
 More options Sep 14 2007, 9:33 am
From: JLH
Date: Fri, 14 Sep 2007 06:33:21 -0700
Local: Fri, Sep 14 2007 9:33 am
Subject: Re: Lost Homepage in index and cache
I don't think duplicate content will get you deindexed when Google
just went out of their way to explain how they handle URLs that are
duplicated.

http://googlewebmastercentral.blogspot.com/2007/09/google-duplicate-c...

I think that is one of those urban myths.

On Sep 14, 7:13 am, berto_s wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JLH  
View profile  
(1 user)  More options Sep 21 2007, 12:58 am
From: JLH
Date: Fri, 21 Sep 2007 04:58:31 -0000
Local: Fri, Sep 21 2007 12:58 am
Subject: Re: Lost Homepage in index and cache
things that go BUMP in the night....

On Sep 14, 8:33 am, JLH wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
(2 users)  More options Sep 21 2007, 2:40 am
From: Phil Payne
Date: Thu, 20 Sep 2007 23:40:00 -0700
Subject: Re: Lost Homepage in index and cache

> things that go BUMP in the night....

Quite agree.  I still see occasional sites that seem perfectly indexed
except the actual home page is nowhere to be found, even on a site:
search when there are only four pages on the site.  Google shows three
of 'em but not the index.html - it's really weird and it would be nice
to know that Google is at least aware it's happening.

The other search engines don't seem to have this deficiency.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Adam Cooper  
View profile  
(1 user)  More options Oct 3 2007, 7:10 am
From: Adam Cooper
Date: Wed, 03 Oct 2007 11:10:37 -0000
Local: Wed, Oct 3 2007 7:10 am
Subject: Re: Lost Homepage in index and cache
Has anyone discovered a solution to this issue? It's really begining
to irritate. Especially as my server logs show that googlebot is
visiting my homepage often.

On Sep 21, 7:40 am, Phil Payne wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
 More options Oct 3 2007, 7:40 am
From: Phil Payne
Date: Wed, 03 Oct 2007 04:40:37 -0700
Local: Wed, Oct 3 2007 7:40 am
Subject: Re: Lost Homepage in index and cache

> Has anyone discovered a solution to this issue? It's really begining
> to irritate. Especially as my server logs show that googlebot is
> visiting my homepage often.

No, butt I've suggested this as one topic in Adam's thread at
http://groups.google.com/group/Google_Webmaster_Help-Indexing/browse_...

    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Susan Moskwa Google employee  
View profile  
(5 users)  More options Oct 5 2007, 4:34 pm
From: Susan Moskwa
Date: Fri, 05 Oct 2007 13:34:38 -0700
Local: Fri, Oct 5 2007 4:34 pm
Subject: Re: Lost Homepage in index and cache
Hi all--
Although there'd be a nice sense of closure in being able to say that
these incidents were all due to a single cause, or could all be
resolved by a one-time fix, after sleuthing around it seems such is
not the case. I looked into six sites who had reported that their
homepage wasn't indexed, and in each case it was due to something
different.

The good news is that out of these six, five now have their homepages
indexed. Most cases were due to some sort of temporary error that
resolved itself in a subsequent crawl. But what was going on, and what
can you as a webmaster do to prevent or resolve such a situation?

1) Check your server's health.
Most of these pages were unavailable (in some fashion) when we tried
to crawl them. The more uptime you have, the more likely it is that
your content will be available for us to crawl. If we can't crawl it,
we can't index it.

2) Make sure that, if your server does go down or your site becomes
unavailable, it sends the correct error or status.
Of course, no one has 100% uptime. But returning the correct status
while your server is down can influence how Googlebot subsequently
crawls your site. Imagine calling a friend and hearing this message on
their voicemail: "Thanks for calling; I've stepped out to lunch for a
bit, please call back later." You'll probably try calling them back in
an hour or two, right? Whereas if you heard this message: "Hey; I'm on
vacation in the Adirondacks all this month with no cell phone
service," you're probably going to wait several weeks before trying to
reach them again.
The same is true of Googlebot; if your site is sending the message "I
don't exist anymore" when it really only needed a 503 (Temporarily
Unavailable), we may wait some time before attempting to recrawl it,
even if its actual downtime is very brief.

3) If you have several ways of accessing your homepage, think about
which one you want to be the official ("canonical") version, and
redirect the others to that version.
One of these sites had its homepage content accessible via more than
one URL, and the URL that Google chose to index wasn't the homepage
URL. Check out Maile's post on duplicate content for more details
about causes and solutions:
http://googlewebmastercentral.blogspot.com/2007/09/google-duplicate-c...

4) Get custom error pages.
One of the sites in question returned an error page for awhile: "We're
having server trouble, please stay tuned." However, other sites hosted
by the same hosting company were also returning that same page (it
looked like a template error page provided by the hosting company).
Since we saw that same content on more than one URL, we ended up only
indexing one version of it, and (to the dismay of the webmaster who
reported it here) it wasn't his version.

5) Make sure that your Sitemap is up to date.
If your homepage hasn't gotten crawled for awhile, make sure that you
have a Sitemap that lists your homepage URL. Although a Sitemap
doesn't guarantee that we'll crawl all listed URLs, it's a good way of
letting us know that that URL is important to you and that you want it
included in our crawl.
A Sitemap can also help with #3 above; if we find several URLs on your
site that point to the same content, but only one of them is in your
Sitemap, we'll use that URL as the canonical URL.

6) Give it time.
I know how webmasters love hearing this, especially since even a day
can seem like an eternity in internet-time; but see #2 above. If your
server has told Googlebot that it's down for the count, sometimes the
only thing you can do (after trying #1-5 above!) is to keep your
server healthy and wait until we come back to crawl again.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam I Am  
View profile  
(5 users)  More options Oct 5 2007, 6:32 pm
From: Sam I Am
Date: Fri, 05 Oct 2007 15:32:48 -0700
Local: Fri, Oct 5 2007 6:32 pm
Subject: Re: Lost Homepage in index and cache
Thanks Susan; interesting post!

When you say 6) Give it time - what kind of time frame are we talking
about? Some of these posters mentioned Google hitting their site
regularly even while it wasn't showing and is that an indication that
you will be able to expect things to jump back into place within a few
days/weeks/months?

How about a site like ours that has been penalized for 5 months yet
isn't breaching any of Google's terms? Is this due to the hour or two
of downtime we suffered a few days before the drop when we changed
server locations?!

On Oct 5, 10:34 pm, Susan Moskwa wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bruce mcnellie  
View profile  
 More options Oct 8 2007, 6:24 pm
From: Bruce mcnellie
Date: Mon, 08 Oct 2007 15:24:56 -0700
Local: Mon, Oct 8 2007 6:24 pm
Subject: Re: Lost Homepage in index and cache
Thanks for the information. I have a specific question I hope you can
address:

I am the webmaster for a small hotel in Gutemala near Tikal. The site
I built for the hotel has been number 1 on Google for the last 7
years. A month ago I upgraded the site  with the hosting service to a
secure site with security certificate. About two weeks ago the site
dropped out of Google's index. I am baffled as is the owner of the
site. Business has dropped off as Google was one of our major sources
for visitors to the hotel.

Yesterday, I registered through Google's process, and got it verified/
authenticated and made sure the site was 'ok' (though it has been
number 1 for all this time) and had someone else look at it.

Any suggestions or insight will be very very very helpful. the site's
owner is considering paying a good deal of money to 'correct' this,
but I am not certain of what will help get the site restored  or at
least indexed and ranked higher.

Thanks in advance and I would appreciate an email if you have time as
I am struggling with the myriad links to get to this page.

Bruce McNellie
webmaster for http://www.lacasadedondavid.com
[email address]

On Oct 5, 3:34 pm, Susan Moskwa wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SaraSchu  
View profile  
(1 user)  More options Oct 9 2007, 2:32 pm
From: SaraSchu
Date: Tue, 09 Oct 2007 11:32:45 -0700
Local: Tues, Oct 9 2007 2:32 pm
Subject: Re: Lost Homepage in index and cache
Thanks for the reply Susan, but my home page is gone again.  What is
there about the home page that makes it the first to disappear when
things go amiss?  Why is Google perfectly happy with the rest of my
site, but not the home page?  My site is w3c compliant throughout, has
totally unique content, has many links from it to the outside world
and vice versa etc. etc.  My hat is so white that it is blinding, but
still Google ignores my home page.  Yahoo and MSN have had absolutely
no problem with my home page or the rest of the site, they update
pages within 3 days of any changes.  Google reads my robots.txt file
every day or so, so just what is it doing with it when it reads it?
This has been happening for over a year and a half now, so patience
does not seem to be the answer.  Could you please just kill a few
chickens for me and sprinkle the blood over the servers where my site
is indexed?  I will light a few candles at this end.

On Oct 8, 5:24 pm, Bruce mcnellie wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
 More options Oct 9 2007, 2:53 pm
From: Phil Payne
Date: Tue, 09 Oct 2007 11:53:01 -0700
Local: Tues, Oct 9 2007 2:53 pm
Subject: Re: Lost Homepage in index and cache

> Thanks for the reply Susan, but my home page is gone again.  What is
> there about the home page that makes it the first to disappear when
> things go amiss?

This is really quite odd.

http://congregational.faithweb.com/  and http://www.congregational.faithweb.com/
both give a server response of 200 and serve the same page.  This
should not be - one should be 301 redirected to the other.  Pick one,
do this, and set the default in Webmaster Tools.

See  http://www.mattcutts.com/blog/seo-advice-url-canonicalization/

But the fun bit is:

Non-www form - http://www.google.co.uk/search?hl=xx-bork&q=site%3Ahttp%3A%2F%2Fcongr...

Loads of pages,, but not the home page.

WWW form - http://www.google.co.uk/search?hl=xx-bork&q=site%3Ahttp%3A%2F%2Fwww.c...

And that would otherwise look like a ban.  No pages in www form at all.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SaraSchu  
View profile  
 More options Oct 9 2007, 5:39 pm
From: SaraSchu
Date: Tue, 09 Oct 2007 14:39:53 -0700
Local: Tues, Oct 9 2007 5:39 pm
Subject: Re: Lost Homepage in index and cache
Phil, you come up with the most amazing discoveries!  That second link
is beyond bizarre.
I picked the non-www version in webmaster tools over a year ago.
Freeservers won't let me do the 301 redirect.  They have not allowed
sites to have .htaccess files since about the end of August. (I know
move somewhere else and be totally lost for the next six months.)
None of this should have anything to do with whether Google can index
my home page.  If Yahoo can find and index the page, why can't Google?

On Oct 9, 1:53 pm, Phil Payne wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam I Am  
View profile  
 More options Oct 10 2007, 3:53 am
From: Sam I Am
Date: Wed, 10 Oct 2007 00:53:00 -0700
Subject: Re: Lost Homepage in index and cache
Sara, you should move and it shouldn't mean you will be totally lost
for the next six months. If you own that domain (faithweb.com), it's
just a matter of changing host but that 'shouldn't' matter to the
search engines. I put that in quotes, because I'm not so sure anymore,
but theoretically it shouldn't :)

On Oct 9, 11:39 pm, SaraSchu wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
(1 user)  More options Oct 10 2007, 6:03 am
From: Phil Payne
Date: Wed, 10 Oct 2007 03:03:00 -0700
Subject: Re: Lost Homepage in index and cache

> I picked the non-www version in webmaster tools over a year ago.
> Freeservers won't let me do the 301 redirect.  They have not allowed
> sites to have .htaccess files since about the end of August. (I know
> move somewhere else and be totally lost for the next six months.)

You have to move.

As long as you retain the domain name, you will certainly not be "lost
for six months".

I suggest moving, getting the 301 set up, clearing out any other
rubbish and then submitting a reinclusion request from the Webmaster
Tools console explaining the difficulties you had getting Google's
recommended configuration from your old host.

If the move is done properly, the most you should be out is a day or
so.  With real skill and co-ordination between old and new suppliers,
it could be minutes.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
SaraSchu  
View profile  
 More options Oct 10 2007, 11:18 am
From: SaraSchu
Date: Wed, 10 Oct 2007 08:18:32 -0700
Local: Wed, Oct 10 2007 11:18 am
Subject: Re: Lost Homepage in index and cache
Thanks at lot Phil, I am convinced, I will look into moving.  The
problem is that freeservers owns faithweb.com. I don't know if I can
own congregational.faithweb.com and simply move it to another server.
Plus, I can't redirect from congregational.freeservers.com to a new
URL.  If you have any ideas how to move from this mess, I would be
very grateful.

On Oct 10, 5:03 am, Phil Payne wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
(1 user)  More options Oct 10 2007, 11:39 am
From: Phil Payne
Date: Wed, 10 Oct 2007 08:39:59 -0700
Local: Wed, Oct 10 2007 11:39 am
Subject: Re: Lost Homepage in index and cache

> Thanks at lot Phil, I am convinced, I will look into moving.  The
> problem is that freeservers owns faithweb.com. I don't know if I can
> own congregational.faithweb.com and simply move it to another server.
> Plus, I can't redirect from congregational.freeservers.com to a new
> URL.  If you have any ideas how to move from this mess, I would be
> very grateful.

Then there's only the long and painful way.

Get your own new domain, get it set up, and get your pages loaded onto
it.  Having potentially to do this sort of thing is one good reason to
use relative addressing within a site - with that, offline use in
handhelds, and offline testing I can't understand Matt Cutts' supposed
preference for complete URLs.

Once it's going, put up HTML redirects on the old site.  E.g., as
http://www.congregational.faithweb.com/index.html you could have:

<html>
<head>
<title>Old site redirector</title>
<meta name="description" content="A redirector page">
<meta name="robots" content="noindex, follow:>
<meta http-equiv="refresh" content="0; URL="http://www.newdomain.com/
index.html">
</head>
<body>
<p align="center">You should be redirected automatically after a few
seconds...<br>If this doesn't happen, please click <a href="http://
www.newdomain.com/index.html"></p>
</body>
</html>


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
 More options Oct 10 2007, 11:40 am
From: Phil Payne
Date: Wed, 10 Oct 2007 08:40:27 -0700
Local: Wed, Oct 10 2007 11:40 am
Subject: Re: Lost Homepage in index and cache
Sorry - typo:

<html>
<head>
<title>Old site redirector</title>
<meta name="description" content="A redirector page">
<meta name="robots" content="noindex, follow">
<meta http-equiv="refresh" content="0; URL="http://www.newdomain.com/
index.html">
</head>
<body>
<p align="center">You should be redirected automatically after a few
seconds...<br>If this doesn't happen, please click <a href="http://
www.newdomain.com/index.html"></p>
</body>
</html>


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Messages 1 - 25 of 64   Newer >
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google