Recrawl question(s)

10 views
Skip to first unread message

Motorhead Extraordinaire

unread,
Oct 22, 2009, 5:53:18 PM10/22/09
to SOFTplus GSiteCrawler
I just did a major reorganization of my eCommerce web site and moved
categories and products all around. I also generated a .htaccess file
that did a "Redirect 301 From To" for everything that moved about.

I just kicked off a recrawl with GSiteCrawler and it looks like GSC is
crawling the old URL's frorm what was last in the database. These must
then redirected to the new URL via the .htaccess redirects. What I do
not understand is if GSG is actually throwing out the old URL's or
not. It looks like they are persistent in the listings. I don;t
really want to run this for hour upon hour just to end up with an out-
dated sitemap.

I would prefer to direct GSC to do a completely new crawl but can't
seem figure out how to tell GSC to do that without trashing the
current project and starting a new one. Is this what I need to do?

Any suggestions would be appreciated.

Thanks,
Joe

Christina S

unread,
Oct 23, 2009, 12:45:00 AM10/23/09
to gsitec...@googlegroups.com
You can delete all the currently listed urls from URL List (option Delete
all non-manual urls) and start a fresh crawl after that.
Christina
www.webado.net

Joe Germann

unread,
Oct 23, 2009, 8:15:17 AM10/23/09
to gsitec...@googlegroups.com
Many thanks.

Joe

MOTORHEAD extraordinaire
Professional Storage and Workspace Solutions
79 Park Road - Chelmsford, MA - 01824
Toll Free 800.618.8028 - Direct 978.618.2800 - Fax 978.418.0404
Visit our web site at www.MotorheadExtraordinaire.com and
for our latest specials, sign up for our Newsletter

Reply all
Reply to author
Forward
0 new messages