Reprocessing all events to Solr

20 views
Skip to first unread message

Marcel van W

unread,
Nov 4, 2017, 5:49:09 PM11/4/17
to SiteWhere
Hi,

I want to use Solr to add some extra search capabilities to sitewhere, but I already have a lot of events in sitewhere. Is it possible to get all the allerts and measurements that are already in sitewhere to Solr?

Thanks,

Marcel

Derek Adams

unread,
Nov 4, 2017, 6:46:14 PM11/4/17
to SiteWhere
There is not a built-in function for sending existing events back though the pipeline. One option would be to start a second SiteWhere instance and use the REST services to pull events from the first instance and push them to the second instance which would be indexing the events into Solr. You could then get rid of the second SiteWhere instance and point the first one to the populated Solr server.

With the upcoming SiteWhere 2.0 architecture, this will be relatively easy to do. Since Apache Kafka has a record of all of the processed events, you can reset the offsets for the stream of decoded events and let them replay to index the data again. We are still a few weeks out from the early access release of SiteWhere 2.0, but it will definitely provide a lot more flexibility in the ways events are processed/reprocessed.

Thanks,
Derek
Reply all
Reply to author
Forward
0 new messages