Account Options

  1. Sign in
The old Google Groups will be going away soon.
Switch to the new Google Groups.
Google Groups Home
« Groups Home
Discussions > Google webmaster tools > Removing HTTPS site caused entire HTTP site to be removed from index
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  21 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
mark B.  
View profile  
 More options Jul 1 2008, 10:11 pm
From: mark B.
Date: Tue, 1 Jul 2008 19:11:21 -0700 (PDT)
Local: Tues, Jul 1 2008 10:11 pm
Subject: Removing HTTPS site caused entire HTTP site to be removed from index
Hi, I recently removed the HTTPS version of a site (https://
www.indybay.org:443/) from the index using Webmaster Tools.  However
this apparently caused the entire HTTP site (http://www.indybay.org/)
to disappear from Google's index as well.  This is of course very bad,
since we do rely on Google to bring readers to the site :)

It seems like this may be a bug with Google Webmasters Tools.  Also, I
would like to request that http://www.indybay.org/ be restored to the
index as soon as possible.

I did try clicking on the "Re-include" button next to my removal
request.  However this resulted in an error message, "Oops! We
couldn't do that because of an error. Please try again!"

Thanks very much for any assistance anyone can provide.

--mark B.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 1 2008, 11:00 pm
From: webado
Date: Tue, 1 Jul 2008 20:00:20 -0700 (PDT)
Local: Tues, Jul 1 2008 11:00 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
How did you remove it?

On Jul 1, 10:11 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 1 2008, 11:01 pm
From: webado
Date: Tue, 1 Jul 2008 20:01:21 -0700 (PDT)
Local: Tues, Jul 1 2008 11:01 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
It's not removed in any case:
http://www.google.com/search?sourceid=navclient&ie=UTF-8&rlz=1T4GGIH_...

On Jul 1, 10:11 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 1 2008, 11:20 pm
From: mark B.
Date: Tue, 1 Jul 2008 20:20:14 -0700 (PDT)
Local: Tues, Jul 1 2008 11:20 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi,
I do not see any results at http://www.google.com/search?q=site:www.indybay.org

--mark

On Jul 1, 8:01 pm, webado wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 1 2008, 11:20 pm
From: mark B.
Date: Tue, 1 Jul 2008 20:20:52 -0700 (PDT)
Local: Tues, Jul 1 2008 11:20 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi, I removed it via Webmaster Tools at
https://www.google.com/webmasters/tools/wm?action=create&siteUrl=http...

--mark

On Jul 1, 8:00 pm, webado wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 1 2008, 11:56 pm
From: webado
Date: Tue, 1 Jul 2008 20:56:06 -0700 (PDT)
Local: Tues, Jul 1 2008 11:56 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
I see 42200 pages indexed according to the site: query. Maybe you end
up in the one lone datacenter that doesn't have it.

When I asked about how you removed I mean for you to explain how. Did
you use robots.txt file to disallow access to the site? You'd have had
to do that to get it removed.

But this also results in removing the http:// copy because there is a
single robots.txt file for both.

I see the robots.txt file is Ok now, not disallowing the entire site.

.

On Jul 1, 11:20 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 2 2008, 12:10 am
From: mark B.
Date: Tue, 1 Jul 2008 21:10:02 -0700 (PDT)
Local: Wed, Jul 2 2008 12:10 am
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
That's interesting, I will continue checking to see if the indexed
pages are disappearing or reappearing. Another symptom of the problem
is that Webmaster Tools Overview page reads: "Index status: No pages
from your site are currently included in Google's index. Indexing can
take time. You may find it helpful to review our information for
webmasters and webmaster guidelines."

We have different robots.txt files at https://www.indybay.org/robots.txt
and http://www.indybay.org/robots.txt, robots are denied only on the
HTTPS site.

--mark

On Jul 1, 8:56 pm, webado wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Discussion subject changed to "Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index" by Red Cardinal
Red Cardinal  
View profile  
 More options Jul 2 2008, 1:26 am
From: Red Cardinal
Date: Tue, 1 Jul 2008 22:26:02 -0700 (PDT)
Local: Wed, Jul 2 2008 1:26 am
Subject: Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index
Not so sure that's a great idea TBH. I don't think Google handles
HTTPS and HTTP versions as completely different sites, even though it
sometimes appears that way from search results.

This is an interesting test case however. It would be grat to get some
clarification from Googlers on this issue.

I think the best solution is to not let your site resolve on HTTPS
unless SSL is required for specific pages.

Rgds
Richard

On Jul 2, 5:10 am, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Discussion subject changed to "Removing HTTPS site caused entire HTTP site to be removed from index" by webado
webado  
View profile  
 More options Jul 2 2008, 7:03 am
From: webado
Date: Wed, 2 Jul 2008 04:03:16 -0700 (PDT)
Local: Wed, Jul 2 2008 7:03 am
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
OK, strange setup but whatever.

So did you also submit the site twice, once with https and the other
witthout?

The message could be referring to the https version - no pages are
indexed for that.

On Jul 2, 12:10 am, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile  
 More options Jul 2 2008, 7:17 am
From: cristina
Date: Wed, 2 Jul 2008 04:17:06 -0700 (PDT)
Local: Wed, Jul 2 2008 7:17 am
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi Mark,
Did you submit a sitemap for your site
(the http version)?
If so, are there error messages for the sitemap?

Cristina.

On Jul 2, 12:10 am, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Red Cardinal  
View profile  
 More options Jul 2 2008, 8:09 am
From: Red Cardinal
Date: Wed, 2 Jul 2008 05:09:10 -0700 (PDT)
Local: Wed, Jul 2 2008 8:09 am
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Some particular reason why you changed the Subject?

I'd sort of appreciate some official chiming in if it was possible.

Rgds
RIchard

On Jul 2, 12:03 pm, webado wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile  
 More options Jul 2 2008, 9:59 am
From: cristina
Date: Wed, 2 Jul 2008 06:59:15 -0700 (PDT)
Local: Wed, Jul 2 2008 9:59 am
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi Richard,
I obviously do not know exactly why the subject line
was changed,
but I think because it was an answer to
a posting in the thread above the point
where you changed the subject,
not an actual editing of the subject line.

Cristina.

On Jul 2, 1:09 pm, Red Cardinal wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Red Cardinal  
View profile  
 More options Jul 2 2008, 12:12 pm
From: Red Cardinal
Date: Wed, 2 Jul 2008 09:12:18 -0700 (PDT)
Local: Wed, Jul 2 2008 12:12 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
crummy groups S/W :D

Now I know why it's happened to me in the past. LOL

Apologies - tinhat left at door from now on :)

Rgds
Richard

On Jul 2, 2:59 pm, cristina wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 2 2008, 3:56 pm
From: mark B.
Date: Wed, 2 Jul 2008 12:56:05 -0700 (PDT)
Local: Wed, Jul 2 2008 3:56 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi,
I've never submitted a site map in the past 8 years the site has been
online, and didn't want to try anything "fancy" until I resolved
this :)

The site appears to be back in the index, I am now getting results at
http://www.google.com/search?q=site:www.indybay.org

I'm not sure what did it -- I did submit the site for
"reconsideration" thru https://www.google.com/webmasters/tools/reconsideration?hl=en
with a note about what happened.

--mark

On Jul 2, 4:17 am, cristina wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 2 2008, 4:03 pm
From: webado
Date: Wed, 2 Jul 2008 13:03:23 -0700 (PDT)
Local: Wed, Jul 2 2008 4:03 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
I didn't change it but I replied to a post above where you had changed
it so it reverted to the original.
Sorry..

On 2 juil, 08:09, Red Cardinal wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cristina  
View profile  
 More options Jul 2 2008, 5:48 pm
From: cristina
Date: Wed, 2 Jul 2008 14:48:21 -0700 (PDT)
Local: Wed, Jul 2 2008 5:48 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi Mark,
What I meant about the sitemap was that
a sitemap, as you know, is a way to inform
Googlebot of which URLs you want indexed for
your site, and I think submitting a good sitemap
would help you in getting your site re-indexeded.

Cristina.

On Jul 2, 8:56 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 2 2008, 6:34 pm
From: mark B.
Date: Wed, 2 Jul 2008 15:34:12 -0700 (PDT)
Local: Wed, Jul 2 2008 6:34 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
Hi Cristina,
As far as I can tell, the site did not need to be re-indexed; having
the HTTPS site removed caused the site to not appear in search
results, but my guess is the pages were not actually removed from
Google's index altogether.  We haven't seen a flood of Googlebot
visits.

As far as Webmaster Tools, it now shows that my request to remove
https://www.indybay.org:443/ was "Canceled", so that probably explains
why the site is listed again. The overview index status for
http://www.indybay.org/ still reads "No pages from your site are
currently included in Google's index" but that may just be stale info
that will get refreshed sometime soon.

--mark

On Jul 2, 2:48 pm, cristina wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 2 2008, 7:44 pm
From: webado
Date: Wed, 2 Jul 2008 16:44:38 -0700 (PDT)
Local: Wed, Jul 2 2008 7:44 pm
Subject: Re: Removing HTTPS site caused entire HTTP site to be removed from index
If the site was submitted as https the infromation on that will say
none are indexed.
Submit the site again as http as a seprate entry and you will see what
information you have for that.

On Jul 2, 6:34 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Discussion subject changed to "Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index" by JohnMu
JohnMu Google employee  
View profile  
 More options Jul 3 2008, 2:15 am
From: JohnMu
Date: Wed, 2 Jul 2008 23:15:51 -0700 (PDT)
Local: Thurs, Jul 3 2008 2:15 am
Subject: Re: Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index
Hi everyone!

I just wanted to confirm Richard's suspicion -- yes, the URL removal
tool removes both the https:// and the http:// versions of the URL.
Additionally, it also removes both the www and the non-www versions
(if relevant). Some of the documentation and the descriptions within
Webmaster Tools look like they might be incorrect, we're working on
fixing that in one of the upcoming releases (it takes a lot of time to
get all the translations in :-)).

Many webmasters do not have their servers set up in a way that only
one version of the URL is actually available. It's important to us
that if they want their content removed, that it's really removed
(including all versions that we might know about). The URL removal
tool is not something that should be use to "optimize" your site's
indexing, to remove canonical versions -- the best way to handle that
is still on the server side, with simple 301 redirects (and of course
the "preferred domain" setting within Webmaster Tools).

I hope that makes things clearer!
John

PS I'm glad the canceling of your URL removal came through, Mark, it
looks like there was a bit of delay in the system for a while.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
mark B.  
View profile  
 More options Jul 3 2008, 6:56 pm
From: mark B.
Date: Thu, 3 Jul 2008 15:56:43 -0700 (PDT)
Local: Thurs, Jul 3 2008 6:56 pm
Subject: Re: Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index
Thanks JohnMu!
We are not using 301 redirects for HTTPS, because some users need or
prefer to use HTTPS.  But we did add a separate robots.txt as well as
meta robots tag for the HTTPS site, so hopefully only the HTTP site
will be indexed from now on.

--mark

On Jul 2, 11:15 pm, JohnMu wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
 More options Jul 4 2008, 12:30 am
From: webado
Date: Thu, 3 Jul 2008 21:30:21 -0700 (PDT)
Local: Fri, Jul 4 2008 12:30 am
Subject: Re: Any Googler Clarification Pls? - Removing HTTPS site caused entire HTTP site to be removed from index
Maybe instead of doing it via the robots.txt you can add noindex meta
tags to the https versions.

On Jul 3, 6:56 pm, mark B. wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »