Account Options

  1. Sign in
The old Google Groups will be going away soon.
Switch to the new Google Groups.
Google Groups Home
« Groups Home
Discussions > Random chit-chat > Setting crawl rate...
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  9 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
lewissr2  
View profile  
 More options Oct 16 2007, 11:56 pm
From: lewissr2
Date: Tue, 16 Oct 2007 20:56:48 -0700
Local: Tues, Oct 16 2007 11:56 pm
Subject: Setting crawl rate...
At Webmaster central I can't use the "Set Crawl Rate" because there is
no clickable link (Its there, just can't click). I am just wondering
if this is because I have the "Revisit After" in the meta tags on my
site or if this is a problem at central itself ?

http://www.freewebs.com/lcsworks/index.htm


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Susan Moskwa Google employee  
View profile  
 More options Oct 19 2007, 6:53 pm
From: Susan Moskwa
Date: Fri, 19 Oct 2007 15:53:33 -0700
Local: Fri, Oct 19 2007 6:53 pm
Subject: Re: Setting crawl rate...
Hi lewissr2--
The crawl rate tool is only available for sites at the domain or
subdomain level; since your site is in a subfolder (/lcsworks), the
tool is unavailable for that particular site. If you can verify
freewebs.com or a subdomain of freewebs.com, you'll be able to set the
crawl rate for one of those sites.

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
lewissr2  
View profile  
 More options Oct 19 2007, 9:10 pm
From: lewissr2
Date: Fri, 19 Oct 2007 18:10:03 -0700
Local: Fri, Oct 19 2007 9:10 pm
Subject: Re: Setting crawl rate...
Thankyou much.

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Randy P.  
View profile  
 More options Oct 20 2007, 4:19 am
From: Randy P.
Date: Sat, 20 Oct 2007 01:19:33 -0700
Local: Sat, Oct 20 2007 4:19 am
Subject: Re: Setting crawl rate...

On Oct 19, 5:53 pm, Susan Moskwa wrote:

> Hi lewissr2--
> The crawl rate tool is only available for sites at the domain or
> subdomain level; since your site is in a subfolder (/lcsworks), the
> tool is unavailable for that particular site. If you can verify
> freewebs.com or a subdomain of freewebs.com, you'll be able to set the
> crawl rate for one of those sites.

Susan is this something new?  Because the crawl rate has been grayed
out for a long time now for most true domain sites.
Randy

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Randy P.  
View profile  
 More options Oct 20 2007, 4:25 am
From: Randy P.
Date: Sat, 20 Oct 2007 01:25:14 -0700
Local: Sat, Oct 20 2007 4:25 am
Subject: Re: Setting crawl rate...

On Oct 16, 10:56 pm, lewissr2 wrote:

> At Webmaster central I can't use the "Set Crawl Rate" because there is
> no clickable link (Its there, just can't click). I am just wondering
> if this is because I have the "Revisit After" in the meta tags on my
> site or if this is a problem at central itself ?

> http://www.freewebs.com/lcsworks/index.htm

Lewis it wouldn't hurt to do something about that potential dupe
content penalty, why take the chance.
http://www.freewebs.com/lcsworks/index.htm
http://www.freewebs.com/lcsworks/
You may not be able to do anything about it though since it's not
really your site (not your domain).

If you know enough about sites and HTML right now, now may be a good
time to get your domain.  You already have the HTML code for it.  You
can transfer the pages at your current site to a new one, then close
the old one.  Of course I wouldn't do this if you're ranking ok with
the current site.
Randy


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Susan Moskwa Google employee  
View profile  
 More options Oct 20 2007, 2:26 pm
From: Susan Moskwa
Date: Sat, 20 Oct 2007 11:26:31 -0700
Local: Sat, Oct 20 2007 2:26 pm
Subject: Re: Setting crawl rate...
On Oct 20, 1:19 am, Randy P. wrote:

> Susan is this something new?  Because the crawl rate has been grayed
> out for a long time now for most true domain sites.
> Randy

I'm not sure, but I can check on that for you... do you have some
example URLs I can look into?

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Oct 20 2007, 3:00 pm
From: webado
Date: Sat, 20 Oct 2007 12:00:59 -0700
Local: Sat, Oct 20 2007 3:00 pm
Subject: Re: Setting crawl rate...
This message appears for some sites:

The rate at which Googlebot crawls is based on many factors. At this
time, crawl rate is not a factor in your site's crawl. If it becomes a
factor, the Faster option below will become available.

In this case the option for a faster crawl rate is greyed out.

For other sites all 3 options (faster, normal, slower) are available
and the message appears as:

We've detected that Googlebot is limiting the rate at which it crawls
pages on your site to ensure it doesn't use too much of your server's
resources. If your server can handle additional Googlebot traffic, we
recommend that you choose Faster below.

On Oct 20, 2:26 pm, Susan Moskwa wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Susan Moskwa Google employee  
View profile  
 More options Oct 20 2007, 6:52 pm
From: Susan Moskwa
Date: Sat, 20 Oct 2007 15:52:02 -0700
Local: Sat, Oct 20 2007 6:52 pm
Subject: Re: Setting crawl rate...
Oh, good call--I may have just been totally misunderstanding Randy's
question.

Randy, if you can see the crawl rate tool (i.e. there's a link to it
on the Tools page) but the 'Faster' option is grayed out for you,
that's an expected behavior (as webado has described). You can find
more info about this in a previous post I did:

http://groups.google.com/group/Google_Webmaster_Help-Tools/t/accbf9fa...

In lewissr2's case, however, there's no way to click into the crawl
rate tool (on the 'Tools' page, the "Set crawl rate" text is grayed
out, it's not a link). If you're seeing this behaviour for sites at
the domain level, feel free to post the URLs and I can check on that
for you.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Randy P.  
View profile  
 More options Oct 21 2007, 12:41 am
From: Randy P.
Date: Sat, 20 Oct 2007 21:41:11 -0700
Local: Sun, Oct 21 2007 12:41 am
Subject: Re: Setting crawl rate...
Yeah I see that area: "The rate at which Googlebot crawls is based on
many factors. At this time, crawl rate is not a factor in your site's
crawl. If it becomes a factor, the Faster option below will become
available", but why is that showing up now instead of the option to
select "faster"?  "Faster" was there but it was removed as an option
for most sites, that's why I mentioned it's no longer an option for
most websites, even if they are a true domain.

I assume this is still the case since I haven't been able to login to
my WMT area for quite some time now.
Randy

On Oct 20, 5:52 pm, Susan Moskwa wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »