Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Google Crawl Date Variable

0 views
Skip to first unread message

Search Iberia

unread,
Nov 7, 2001, 9:40:31 AM11/7/01
to
If you do a search for the following in Google ...

x google crawl date

... and then look at the cache of any of the resulting pages, you'll see
that what appears to be the date of Google's last spider of that particular
page is included in the header information with http environment variables,
etc.

Why does this appear on some pages and not others - what makes it appear?
How can this information be used within an html page to see the last time
that page was crawled?

Thanks, Roger.

http://www.SearchIberia.com - the Spain & Portugal search directory

rebelbagwan

unread,
Nov 8, 2001, 1:19:11 AM11/8/01
to
"Search Iberia" <dire...@nospam.searchiberia.com> wrote in message news:<10051440...@ns0.klm.nl>...


-----------------------------------------------------------------------
hi Roger, great find ! I have not seen this before how did you come by
it ?
notice Googles last major crawl was on the 4th, 5th ,6th thru to 8th
of october and because it seems to keep a 28-30 day cycle it should be
just finishing its major November crawl. You can also see if your site
was dated by searching within results "x google crawl date
www.mysite.com".

Looks to me as though these are google stats and have nothing to do
with web site owners .

Search Iberia

unread,
Nov 8, 2001, 2:15:13 AM11/8/01
to
But it doesn't appear on all pages - in fact, out of 3 of my sites it only
appears on 1 page, which I'm sure was created in exactly the same way as all
the others - so what makes it appear?

Roger.
http://www.GoMadrid.com for Madrid hotels, bullfights, museums, flamenco

Justin

unread,
Nov 8, 2001, 5:32:44 PM11/8/01
to
In article <10052037...@ns0.klm.nl>,
"Search Iberia" <dire...@nospam.searchiberia.com> wrote:

No results for any of our sites - but I did see it.

Perhaps, it depends on what server your search is conducted on/provided
from? Much like pdf's were served up, up until they were included on
all.

Cheers, Justin

0 new messages