Construct URL Pattern for Domain or homepage only

1 view
Skip to first unread message

anfernee

unread,
Dec 21, 2009, 10:15:45 PM12/21/09
to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini
Hi,

I would like to ask if its possible to create a URL pattern for the
GSA to having only the domain or homepage of the site?

Example:
I would not like GSA to crawl the homepage of this site which has a
URL of - http://www.samplesite.com, but I would still like the GSA to
crawl other pages within that domain (e.g: http://www.samplesite.com/folder1/page1.htm,
http://www.samplesite.com/folder2/page2.htm, etc).

Is this possible?

johnd

unread,
Dec 25, 2009, 12:13:05 AM12/25/09
to Google Search Appliance/Google Mini - Google Search Appliance/Google Mini
I would configure the gsa to crawl the site including the home page
and then filter out the home page in the front end(s) using the Remove
url's with this pattern ^http://www.samplesite.com/$

John

On Dec 21, 9:15 pm, anfernee <daniel.t.c.hernan...@accenture.com>
wrote:


> Hi,
>
> I would like to ask if its possible to create a URL pattern for the
> GSA to having only the domain or homepage of the site?
>
> Example:
> I would not like GSA to crawl the homepage of this site which has a

> URL of -http://www.samplesite.com, but I would still like the GSA to
> crawl other pages within that domain (e.g:http://www.samplesite.com/folder1/page1.htm,http://www.samplesite.com/folder2/page2.htm, etc).
>
> Is this possible?

Reply all
Reply to author
Forward
0 new messages