Crawl Never Finishes

steveeray

unread,

Dec 24, 2009, 10:29:32 AM12/24/09

to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini

My Google Mini never finishes crawling a site with only 8000
documents. This has just started recently and files are showing they
were crawled last in September, two months ago. I have shut the mini
down and restarted, without success. Not sure where the problem is or
how to resolve. Any help appreciated.

johnd

unread,

Dec 28, 2009, 8:56:23 AM12/28/09

to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini

Your unit is set to "Continuous crawl mode"
http://code.google.com/apis/searchappliance/documentation/62/admin_crawl/Introduction.html#cmodes

Which means it never stops crawling.

John

brianb

unread,

Jan 5, 2010, 1:00:30 AM1/5/10

to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini

The other thing you can try to do is to reset the index to start with
a clean slate if you feel that the crawl is actually stuck.

Edward

unread,

Jan 5, 2010, 9:48:42 AM1/5/10

to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini

You may also want to check the header information that the server is
sending back to the Mini. If the server is telling the mini that the
version it already has is latest, the appliance may never actually be
requesting the contents of the page.

Reply all

Reply to author

Forward