Google Groups Home
Help | Sign in
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  22 messages - Collapse all
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
Maile Ohye Google employee  
View profile
(3 users)  More options Sep 12 2007, 4:17 am
From: Maile Ohye
Date: Wed, 12 Sep 2007 08:17:33 -0000
Local: Wed, Sep 12 2007 4:17 am
Subject: Helping webmasters with duplicate content
Hi everyone,

You may have seen our post on the Webmaster Central Blog:
http://googlewebmastercentral.blogspot.com/2007/09/google-duplicate-c...

We welcome suggestions for helping you with duplicate content caused
by URL parameters.

Thanks!
Maile and all of the Webmaster Central Team


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Red Cardinal  
View profile
(1 user)  More options Sep 12 2007, 6:47 am
From: Red Cardinal
Date: Wed, 12 Sep 2007 10:47:59 -0000
Local: Wed, Sep 12 2007 6:47 am
Subject: Re: Helping webmasters with duplicate content
Perhaps if dupe content was reported so that we could find the
problematic URLs or parameters?  And some report of what the algo
believes is the canonical URL so that if this is incorrect we can
apply additional resources to fixing this on our sides.

As the size of sites grow dealing with dupe content becomes a less
trivial issue.

Nice to see you engaging the community via group.

Best rgds
Richard

On Sep 12, 9:17 am, Maile Ohye wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
OME UK  
View profile
(2 users)  More options Sep 12 2007, 11:05 am
From: OME UK
Date: Wed, 12 Sep 2007 08:05:48 -0700
Local: Wed, Sep 12 2007 11:05 am
Subject: Re: Helping webmasters with duplicate content
I would second this and I was going to say something similar myself -
transparency is important here and it would be really good if this
could be added into the Webmaster Tools reports. Trusting Google to
"consolidate properties of the URLs in the cluster, such as link
popularity, to the representative URL" could easily breed complacency
that the the original problem doesn't need to be fixed and could mean
the number of inadvertant duplicates increases.

BTW - excellently detailed post that helps website owners understand
the true situation, rather than have to rely upon SEO agencies - would
rather hear it direct from you guy's...please keep these type of
updates coming!

Regards,
Paul

On Sep 12, 11:47 am, Red Cardinal wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
JLH  
View profile
 More options Sep 12 2007, 11:18 am
From: JLH
Date: Wed, 12 Sep 2007 15:18:29 -0000
Local: Wed, Sep 12 2007 11:18 am
Subject: Re: Helping webmasters with duplicate content
1)  whatever swedish-fish.jpg is, it's not being shown.

2)  I'm encouraged to see Maile say, "When tracking visitor
information, use 301 redirects to redirect URLs with parameters such
as affiliateID, trackingID, etc. to the canonical version."  I've been
tempted to do this since I've got affiliate links that have caused
some of those links to be seen in the search results (I got some
newspapers that carry a lot of PageRank to be affiliates and their
links are more powerful than the stores themselves), but I didn't want
to appear like I was doing anything too sneaky.  I must admit however,
as the stores have aged Google has gotten the correct URLs listed more
and more.

Off to modify some shopping cart code...

On Sep 12, 10:05 am, OME UK wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
AJS  
View profile
 More options Sep 13 2007, 11:51 am
From: AJS
Date: Thu, 13 Sep 2007 08:51:11 -0700
Local: Thurs, Sep 13 2007 11:51 am
Subject: Re: Helping webmasters with duplicate content
Maile,

Can you clarify what you wrote in the "Why should you care?" section:

"1. Having multiple URLs can dilute link popularity. For example, in
the diagram above, rather than 50 links to your intended display URL,
the 50 links may be divided three ways among the three distinct URLs."

Vs. what you said in the "How we help users and webmasters with
duplicate content" section:

"3. We then consolidate properties of the URLs in the cluster, such as
link popularity, to the representative URL."

If multiple coded URLs are used for tracking (for example www.site.com/story,
www.site.com/story?xid=rss, www.site.com/story?xid=topstories, etc.)
is the link popularity of all the URLs completely consolidated into
the URL that Google deems the "best URL"? Or is link popularity
dilution still an issue?

Thank you.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Snowman2468  
View profile
 More options Sep 14 2007, 9:18 pm
From: Snowman2468
Date: Fri, 14 Sep 2007 18:18:52 -0700
Local: Fri, Sep 14 2007 9:18 pm
Subject: Re: Helping webmasters with duplicate content
I'd like to firstly thank Maile and the Google team for addressing
this.

Here's my vote for Google producing a report that Webmasters and
Siteowners can use to identify URL's that G considers to be duplicate.
I'd like to re iterate earlier remarks here that management of this
with larger sites and unfamiliar CMS software which is widely and
often incorrectly handled is a big problem, even for advanced
websmaster skills.

Ordinary folks will find it even more complex, and we for one have
been struggling with this problem for over 4 years, with a great deal
of skilled input.

On Sep 14, 1:51 am, AJS wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Ian Macfarlane  
View profile
 More options Sep 17 2007, 5:55 am
From: Ian Macfarlane
Date: Mon, 17 Sep 2007 02:55:54 -0700
Local: Mon, Sep 17 2007 5:55 am
Subject: Re: Helping webmasters with duplicate content
The new tool that Yahoo! have to specify which URL parameters are
irrelevant and should be stripped out looks extremely useful, and this
is something we'd all love to see Google support in the future. It's
pretty much exactly what we need to solve this issue in most cases.

Reports of duplicate content that was discovered, as another poster
suggested, would also be extremely useful.

Ian

On Sep 12, 9:17 am, Maile Ohye wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
bradsblog  
View profile
(2 users)  More options Sep 17 2007, 5:42 pm
From: bradsblog
Date: Mon, 17 Sep 2007 14:42:08 -0700
Local: Mon, Sep 17 2007 5:42 pm
Subject: Re: Helping webmasters with duplicate content

I have duplicate content, Could you please link to http://daily-rambler.blogspot.com
instead of
http://daily-rambler.blogspot.com/search?updated-min=2007-01-01T00%3A...

Thanks alot!


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam I Am  
View profile
(2 users)  More options Sep 18 2007, 3:07 am
From: Sam I Am
Date: Tue, 18 Sep 2007 00:07:48 -0700
Local: Tues, Sep 18 2007 3:07 am
Subject: Re: Helping webmasters with duplicate content
I agree, why try and re-invent the wheel? Go with what Yahoo did and
admit they did it first, it is a great idea and you also think so.

If you want to be new and innovative, figure out a way to deal with
xml feeds and tell webmasters straight out if that is or isn't
considered duplicate content and how to deal with it (robots.txt out
is that smart or not?). While I'm on the topic, drop those suckers
from the index OR at least make it clear that they are feeds. 99% of
the people using your search haven't got a clue what they are when
they hit a page like that...

On Sep 17, 11:55 am, Ian Macfarlane wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
silverstall  
View profile
 More options Sep 18 2007, 11:45 am
From: silverstall
Date: Tue, 18 Sep 2007 08:45:01 -0700
Local: Tues, Sep 18 2007 11:45 am
Subject: Re: Helping webmasters with duplicate content
Providing a way through the webmaster console of specifying which
URL's can be grouped whilst at the same time authenticating ownership
by confirming an online declaration of original content in a similar
method employed by Wickopedia when you upload an image to it.
With scraper sites i appreciate creation dates are not always
reliable.  If  site owners are forced to register content, some say
non-savvy site owners wouldn't know to register content however i
believe word would get round pretty quickly particualry if it was
mentioned in webmaster guidleines. I realise that a third party could
take the content and register it instead however i beleive that would
be fewer than the current system where scrapers rely on their own
site's authority and the huge number of links they create to the page
which many more  non-savvy webmasters do not have a clue about. The
flaw is that the scraper will pick on a new site or recently published
URL in the knowledge it has little authority. In the real non-virtual
world creators of original works are already aware of the need to
register trademarks etc so would it not be better to extend this time
tested practice to indexing on search engines rather than rely on a
system which i fear many scrapers know how to cheat.

    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
geminem  
View profile
 More options Sep 21 2007, 9:28 am
From: geminem
Date: Fri, 21 Sep 2007 06:28:16 -0700
Local: Fri, Sep 21 2007 9:28 am
Subject: Re: Helping webmasters with duplicate content
hi, i have a question. i have a website hosted my school's web server
that i transfered to a new web host. i also have my own domain name
now. i have the exact same identical content though (a blog published
through Blogger).

i tried doing a "301" with ".htaccess" like what i read online, but it
doesn't work. i tried putting it in every conceivable folder. i also
saw different versions of what to put inside the .htaccess file, and
tried every possible variation but it doesn't work.

my new web host has a cPanel where you can just click a button and
make a link redirect to something else but my school's web server
doesn't have that (at least not for students). so i can't use that
feature to redirect my old link to my new link.

is there a way i can just write a letter to Google and ask them to
refer to my new domain name when some searches for my site
(Misadventures in Taiwan) in the future?

for reference, the old blog link is: http://web.tnnua.edu.tw/~g920713/blog.1.html
and i would like it if in the future all references to it will point
to http://misadventuresintaiwan.gemismyname.com/old/blog.1.html.

and then the whole site structure link is: OLD: http://web.tnnua.edu.tw/~g920713/,
NEW: http://misadventuresintaiwan.gemismyname.com/old/. the content is
the same.

thank you everyone!

On Sep 12, 4:17 pm, Maile Ohye wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Palo Alto Rookie  
View profile
 More options Sep 22 2007, 1:22 am
From: Palo Alto Rookie
Date: Fri, 21 Sep 2007 22:22:26 -0700
Local: Sat, Sep 22 2007 1:22 am
Subject: Re: Helping webmasters with duplicate content