Zoie and solr 3.3.0 and HourGlass?

58 views
Skip to first unread message

Dan Hopkins

unread,
Sep 29, 2011, 9:28:57 PM9/29/11
to zoie
Hi folks, I've been running an older version of solr 1.41, with a
trunk release solr/hourglass.

My question is with zoie now supporting lucene 3.3.0, does that 'mean'
I should be able to upgrade to solr 3.3.0, with hourglass working?

I'm guessing..yes? but has anyone confirmed the 3 pieces working
together?
also, other then being the latest and greatest should I expect to see
any improvements?

In particular, we have about 2 months of use with solr/zoie/hourglass,
and have started noticing solr becoming unstable and slower, and not
returning/indexing data as expected..only being fixed (improved) with
manual restarts of the solr server. (we are sitting at about 150Gb
total data), and running the solr vm with 7.5GB Ram allocated.
Ultimatly I'm hoping to get revolving index of 3 months which will end
up around 270GB (which may end up doubling as we add new services into
the index).

I take the 'install' path would be similar? build zoie with hourglass
copy the jars into solr-3.3.0 distributation, and update the configs
(which I believe have changed since 1.4.1).

Cheers
Dan




John Wang

unread,
Sep 30, 2011, 11:10:38 AM9/30/11
to zo...@googlegroups.com
Hi Dan:

     Can you share your HG settings?

Thanks

-John





--
You received this message because you are subscribed to the Google Groups "zoie" group.
To post to this group, send email to zo...@googlegroups.com.
To unsubscribe from this group, send email to zoie+uns...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/zoie?hl=en.


Dan Hopkins

unread,
Sep 30, 2011, 11:41:55 AM9/30/11
to zoie
These are the only settings that I have that specific to hourglass.

<updateHandler class="proj.zoie.solr.ZoieUpdateHandler">
</updateHandler>
<indexReaderFactory class="proj.zoie.solr.ZoieSolrIndexReaderFactory" /
>
<zoie.type>hourglass</zoie.type>

<zoie.hourglass.schedule>00 00 00</zoie.hourglass.schedule>
<zoie.hourglass.freq>day</zoie.hourglass.freq>
<!-- keep data for 6 months -->
<zoie.hourglass.trimThreshold>180</zoie.hourglass.trimThreshold>

Devi

unread,
Apr 17, 2012, 7:35:11 AM4/17/12
to zo...@googlegroups.com
I'm trying to build Zoie with Hourglass (both latest) on solr 3.6. After following the instructions at [1], on starting Solr, I get to see the zoie parameters set, followed by errors like

7-abr-2012 11:30:32 proj.zoie.hourglass.impl.HourglassDirectoryManagerFactory getCalendarTime
GRAVE: date formate should be like yyyy-MM-dd-HH-mm-ss
java.text.ParseException: Unparseable date: "segments_6"

I digged through it and found that the default elevate.xml has a doc with id which can't be converted to "long". I get rid of the above errors after commenting that doc in elevate.xml or commenting out the Elevator component in solrconfig.xml. But now, I don't see the zoie/hourglass parameters anymore in solr logs to show that hourglass is in fact working.

Any ideas or suggestions?

Devi

unread,
Apr 18, 2012, 7:57:16 AM4/18/12
to zoie
Things seems to be working smoothly with Zoie 3.1.0 + Solr 3.5.0. It
works with the uniqueId field type to be string in solrconfig.xml, but
expects only numbers (internally the uniqueIds get converted to
longs).
> > > > zoie+uns...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages