Google Groups Home
Help | Sign in
Discussions > Crawling, indexing, and ranking > Blogspot Robots.txt: Disallow: /
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  24 messages - Collapse all
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
vld2czech  
View profile
 More options Jul 22 2007, 9:53 pm
From: vld2czech
Date: Sun, 22 Jul 2007 18:53:28 -0700
Local: Sun, Jul 22 2007 9:53 pm
Subject: Blogspot Robots.txt: Disallow: /
One week ago I found on my blogspot blog (www.stockweb.blogpsot.com)
following formula:

Disallow: /

meaning that nothing is indexed and my number of visitors dropped
sharply. I really don't understand. I hasn't been against Google
guideline and work hard with my blog. I haven't received any message
from Google.

Could you please help me what shall I do or how to contact Google...

Thank you in advance


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile
 More options Jul 22 2007, 10:14 pm
From: webado
Date: Mon, 23 Jul 2007 02:14:39 -0000
Local: Sun, Jul 22 2007 10:14 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
Hmm, you sure you are on blogSPot?

Your url states  . blogPSot.

Whatever that site is, it's got nothing to to with Blogspot and
Blogger.

On Jul 22, 9:53 pm, vld2czech wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile
 More options Jul 22 2007, 10:43 pm
From: webado
Date: Mon, 23 Jul 2007 02:43:33 -0000
Local: Sun, Jul 22 2007 10:43 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
Could it be that yuo have abotu 5 other blogs all looking pretty much
the same way and with about the asme content?
I don't know, just throwing idea around.

Have you listed this blog as public or private?

On Jul 22, 10:14 pm, webado wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
djc  
View profile
 More options Jul 23 2007, 9:25 am
From: djc
Date: Mon, 23 Jul 2007 06:25:25 -0700
Local: Mon, Jul 23 2007 9:25 am
Subject: Re: Blogspot Robots.txt: Disallow: /
http://blogpsot.com/ exists to pickup typos.

The one for the real blogspot has
User-agent: *
Disallow: /search
Disallow: /

I would double check your settings to make sure you didn't make it
private.

On Jul 22, 9:43 pm, webado wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile
 More options Jul 23 2007, 10:20 am
From: webado
Date: Mon, 23 Jul 2007 14:20:24 -0000
Local: Mon, Jul 23 2007 10:20 am
Subject: Re: Blogspot Robots.txt: Disallow: /
I figured out about the typo crap, eventually ;)

The public vs private blog is the likely candidate.

I have mine private but I publish it to my own website so the point is
moot, I handle my own robots.txt and sitemap and all that.

On Jul 23, 9:25 am, djc wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
vld2czech  
View profile
 More options Jul 25 2007, 10:49 am
From: vld2czech
Date: Wed, 25 Jul 2007 07:49:19 -0700
Local: Wed, Jul 25 2007 10:49 am
Subject: Re: Blogspot Robots.txt: Disallow: /
I'm sorry I mistyped.

My url is www.stockweb.blogspot.com

Please any help, I like blogger as it is easy to work with. And I
don't want to tranfer to wordpress and custom domain.

Thank you in advance

On 23 Čec, 17:20, webado wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile
 More options Jul 25 2007, 10:51 am
From: webado
Date: Wed, 25 Jul 2007 07:51:44 -0700
Local: Wed, Jul 25 2007 10:51 am
Subject: Re: Blogspot Robots.txt: Disallow: /
Did you make the blog Public or is it still Private?
Check the dashboard.

On Jul 25, 10:49 am, vld2czech wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
vld2czech  
View profile
 More options Jul 25 2007, 3:42 pm
From: vld2czech
Date: Wed, 25 Jul 2007 12:42:24 -0700
Local: Wed, Jul 25 2007 3:42 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
It is public blog.

Before it has standard robots.txt but 10 days ago changed into
"Disallow: /"

On 25 Čec, 17:51, webado wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
djc  
View profile
 More options Jul 25 2007, 4:41 pm
From: djc
Date: Wed, 25 Jul 2007 13:41:52 -0700
Local: Wed, Jul 25 2007 4:41 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
Set it to private, close your browser....not just the tab, the entire
browser
Open your browser, now change it to public.  Check to see if it's
still "Disallow: /"
If so, I suspect you got banned....or someone has figured out a way to
hack blogspot.

On Jul 25, 2:42 pm, vld2czech wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
djc  
View profile
 More options Jul 25 2007, 4:49 pm
From: djc
Date: Wed, 25 Jul 2007 13:49:38 -0700
Local: Wed, Jul 25 2007 4:49 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
I'm not sure these errors would get you banned, but you need to fix
them

http://www.blogger.com/rsd.g?blogID=6675237082283386719 gives a 405
error.  Your should switch your feed choice to ATOM.
http://archipelago.phrasewise.com/rsd hasn't been used in quite some
time

http://www.blogger.com/comment.g?blogID=6675237082283386719&postID=41...
returns a 400

http://www.blogger.com/comment.g?blogID=6675237082283386719&postID=77...
returns a 400

http://astore.amazon.com/stoceasteurot-20 returns a 405

and those are just a few errors I found

On Jul 25, 2:42 pm, vld2czech wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sebastian  
View profile
 More options Jul 25 2007, 5:43 pm
From: Sebastian
Date: Wed, 25 Jul 2007 21:43:17 -0000
Local: Wed, Jul 25 2007 5:43 pm
Subject: Re: Blogspot Robots.txt: Disallow: /
The www prefix is useless, but the robots.txt under the canonical URL
blocks spiders too. Weird.
http://sebastianx.blogspot.com/2007/07/blogger-to-rule-search-engine....
Sebastian

On Jul 25, 10:49 pm, djc wrote: