Updation/Recrawling is taking toooooo long!!!

[freddiemaize]

Hi all,

The above is the configuration of the GSA box that i'm using. As of
now i have around 50 records (URLs) that are indexed.

Now, when i change/update any of the indexed doucment the changes has
to be (and will) reflect in my search. My doubt is, how long will my
GSA take to reflect the updation in the search result??

i'm asking because, even if i have less number of records (say 50)
indexed, the updation/recarwling is taking toooooo long.

I have configured my crawl mode as Continuous crawl.
My GSA capacity is, "Maximum number of pages overall: 500,000" - as in
my license

Please advice

Freddie

[Mahesh T]

Read this...
http://code.google.com/apis/searchappliance/documentation/50/admin_crawl/Introduction.html#recrawlsched

If you want re-crawl to be done instantaneously, read this...
http://code.google.com/apis/searchappliance/documentation/50/help_gsa/crawl_fresh.html

[freddiemaize]

Hi Mahesh,

Thanks for posting back. I've gone through most of the documentation
on GSA.

All i wanted to know is, eventhough i set my crawl shedule to
"Continuous crawl"mode, changes are not getting reflected quick. In
fact i waited for one whole day.. nothing in my favour happened. :(

I tried everything... everthing like freshness tuning, force recrawal
etc.,

The only way i'm able to show my changes to be reflected quick (i
cannot even say quick. i'm not able to show the changes) is by
clearing the index and do the whole process of crwaling afresh (which
is not recommended i believe).

Freddie

On Nov 6, 6:21 am, Mahesh T <lightbe...@gmail.com> wrote:
> Read this...http://code.google.com/apis/searchappliance/documentation/50/admin_cr...
>
> If you want re-crawl to be done instantaneously, read this...http://code.google.com/apis/searchappliance/documentation/50/help_gsa...

[Apollo]

If fewer pages are indexed, GSA should response faster. I have
experienced the same issue many times.
It is true that the fastest way is to clear all the index and rebuild
again. If go by freshness tuning, it could take days and up to 1 week
to refresh the index.

[Mahesh T]

Have you tried "Always Force Recrawl" and "Recrawl these URL Patterns"
combination on "Freshness Tuning" page?

Place the URL pattern in "Always Force Recrawl" and click "Save
Changes"
Then place the same URL pattern in "Recrawl these URL Patterns" and
click "Recrawl these URL Patterns" button.

If your GSA does not have high load, you can see the changes in 30-60
mins.

[freddiemaize]

Okay. Fine. I would try them out.

But then, i cannot use the Freshness tuning options to my real time
websites. I mean to say that, As of now i'm just indexing sample
records for testing purpose. But when i go for a real time indexing
(hope you understand what i mean) i may not be using any of the
freshness tuning options because of business rule.

So in that case how long will GSA take to reflect the changes?? poor
me..... I suppose its going to take many days together even of minor
change in one record.

Is there anywhere i can report this to??

Freddie

[Mahesh T]

>So in that case how long will GSA take to reflect the changes?

http://code.google.com/apis/searchappliance/documentation/50/admin_crawl/Introduction.html#recrawlsched

>Is there anywhere i can report this to??

https://support.google.com

[freddiemaize]

Mahesh, that answered my question. Thanks

Freddie

On Nov 6, 9:43 am, Mahesh T <lightbe...@gmail.com> wrote:
> >So in that case how long will GSA take to reflect the changes?
>

> http://code.google.com/apis/searchappliance/documentation/50/admin_cr...