Account Options

  1. Sign in
The old Google Groups will be going away soon.
Switch to the new Google Groups.
Google Groups Home
« Groups Home
Google Webmaster Help
Home
About this group
Join this group
Discussions > Crawling, indexing, and ranking > What are URLs restricted by robots.txt errors?
Options
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
   10 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
webado  
View profile  
 More options Jul 20 2007, 11:29 pm
From: webado
Date: Sat, 21 Jul 2007 03:29:13 -0000
Local: Fri, Jul 20 2007 11:29 pm
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
The file robots.txt on the site http://gottagetsomemetime.vstore.ca/
disallows all robots from the entrie site.

You used:

User-agent: *
Disallow: /

This means disallow all robtos from entire site.

What you want to have is this:

User-agent: *
Disallow:

This means disallow nothing. Which means allow everything.

On Jul 20, 10:57 pm, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
ree  
View profile  
 More options Jul 21 2007, 1:10 am
From: ree
Date: Sat, 21 Jul 2007 05:10:42 -0000
Local: Sat, Jul 21 2007 1:10 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
Ummm how do I save it when i leave and return it back to the old way
not the corrected way.

On Jul 21, 12:06 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 21 2007, 1:18 am
From: webado
Date: Sat, 21 Jul 2007 05:18:42 -0000
Local: Sat, Jul 21 2007 1:18 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
Yoo do not edit the robots.txt fiel inside Google Webmaster Tools.

That file is on your server, on your website, in the root folder.

You downlaod it, edit it in Notepad and re-uplaod it.

On Jul 21, 1:10 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
ree  
View profile  
 More options Jul 21 2007, 1:39 am
From: ree
Date: Sat, 21 Jul 2007 05:39:56 -0000
Local: Sat, Jul 21 2007 1:39 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
Do I do the upload from here?  Submit a reconsideration request
Sorry I am so new to this

On Jul 21, 12:18?am, webado wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 21 2007, 2:01 am
From: webado
Date: Sat, 21 Jul 2007 06:01:40 -0000
Local: Sat, Jul 21 2007 2:01 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
No, you have to upload to your website.

How did you build your website?

On Jul 21, 1:39 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 21 2007, 2:03 am
From: webado
Date: Sat, 21 Jul 2007 06:03:08 -0000
Local: Sat, Jul 21 2007 2:03 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
It's as I said because the robots.txt file you have is blocking
everything.

Either just delete that file from your  website or upload the
corrected one as I said.

On Jul 21, 1:43 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 21 2007, 2:40 am
From: webado
Date: Sat, 21 Jul 2007 06:40:24 -0000
Local: Sat, Jul 21 2007 2:40 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
If you do not fix the robtos.txt file that website will forever be
ignored by search engines. I am serious.

Your choice if you want to try to learn or not. I cannot fix it for
you.

On Jul 21, 2:16 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
abracadabra  
View profile  
 More options Jul 21 2007, 6:37 am
From: abracadabra
Date: Sat, 21 Jul 2007 03:37:56 -0700
Local: Sat, Jul 21 2007 6:37 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
Hi Ree! Welcome to our group.

> This is why I am asking ..... I don't know how to fix it

We do not know how you created your website
so it is dificult to provide any specific instructions!

There are many ways one may create a site.
You can create text files by hand and upload them
to a server that hosts your domain,
You can use tools to create your site locally on your
PC and then upload that to your hosting server.
You can do it all online and use a service to create
your website.

We have no Idea what you use so it is impossible
for us to assist you unless you let us know how
you are creating this site and what capabilities
regarding uploads and what actual page editing
capabilities you have.

We can't tell you how to update pages or files in your
webspace as that varies greatly dependent on the service
and implementation choices by you and your provider.

I understand you can be frustrated, but take your time
research and learn. Ask questions from your hosting
provider. Ask them how you can edit the robots.txt file.

Do take webado's advice as an urgent request. Correct
the robots.txt. This file currently contains instructions
that tell all search engines to totally ignore your site!

The one you have in place may be the default set
by your provider. Check with them on how to fix it.

Abracaabra

On Jul 21, 2:47 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 22 2007, 1:50 am
From: webado
Date: Sun, 22 Jul 2007 05:50:07 -0000
Local: Sun, Jul 22 2007 1:50 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
You have to answer the questions we asked you:

What did you use to build your website? How did you build the website?
Do you have access to some kind of control panel, some file manager,
for your website?

On Jul 22, 1:39 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 22 2007, 2:37 am
From: webado
Date: Sun, 22 Jul 2007 06:37:44 -0000
Local: Sun, Jul 22 2007 2:37 am
Subject: Re: What are URLs restricted by robots.txt errors?
Print | Individual message | Report this message | Find messages by this author
All you ned to do is delete the file robps.txt from your site.

You need top get to a place where you see all your files and find that
one and delete it.

Ask yor hoster for guidance how to do that.

On Jul 22, 2:29 am, ree wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2012 Google