Robots have a knack of indexing what you don't want them to and
ignoring what you want them to index.
Don't do it. Don't let them crawl the site before it's actually
finished.
This is no old wives tale.
They come by once, see next to nothing worth indexing, index what
there is (zip) and won't come back for a long time as they have
already classified the site as being basically empty.
To get them to come by and crawl again you will need some good
backlinks at this point, as you'd have wasted your one chance to get
indexed right out of the box. You'll still need the links later, mind
you, just to stay indexed properly, but every new site gets an initial
boost, when it's most important to start being visible so that you can
start acquiring those precious backlinks.
On Aug 2, 10:32 pm, PaulC wrote:
> Hello,
> I was wondering whether having an index page that says under
> construction please check back periodically is worth being indexed and
> crawled by search engine bots...
> do you think this could hurt when i actually release the web site? or
> should i allow bots to be able to crawl and index from day one?
> Thanks!