Lily Solr with Hbase Indexer Batch Index fails

30 views
Skip to first unread message

Santosh Mohanty

unread,
May 15, 2016, 10:05:31 AM5/15/16
to lily-discuss
HI Team ,

  I use lily-solr with Hbase indexer , I have 5 Indexer configurations like :

File : asset_indexerconfig.xml
<indexer xmlns:n="spotlight.covx">

File : brightcoveindex_config.xml
<indexer xmlns:n="spotlight.brightcove">

File : indexconfig.xml:

<indexer xmlns:n="spotlight.time.top.100" xmlns:n1="spotlight.people" xmlns:n2="spotlight.swimsuit">


and so on ..

The process I add index is :

asset_idx01

/usr/lib/hbase-indexer/bin/hbase-indexer add-indexer -n asset_idx01 -z spotlight-prod-cluster01 -cp solr.mode=classic -cp solr.shard.1=http://spotlight-prod-cluster01:7575/solr -r org.lilyproject.indexer.hbase.mapper.LilyIndexerComponentFactory -cp solr.sharder=org.lilyproject.indexer.hbase.mapper.LilySharder -c asset_indexconfig.xml -cp lily.zk=spotlight-prod-cluster01

/usr/lib/hbase-indexer/bin/hbase-indexer update-indexer -n asset_idx01 --batch BUILD_REQUESTED




brightcove_idx01

/usr/lib/hbase-indexer/bin/hbase-indexer add-indexer -n brightcove_idx01 -z spotlight-prod-cluster01 -cp solr.mode=classic -cp solr.shard.1=http://spotlight-prod-cluster01:7575/solr -r org.lilyproject.indexer.hbase.mapper.LilyIndexerComponentFactory -cp solr.sharder=org.lilyproject.indexer.hbase.mapper.LilySharder -c brightcove_indexconfig.xml -cp lily.zk=spotlight-prod-cluster01

/usr/lib/hbase-indexer/bin/hbase-indexer update-indexer -n brightcove_idx01 --batch BUILD_REQUESTED 

Now the Problem is Once asset_idx01 is completed, it indexes all the data and then  brightcove_idx01 starts . in this process all the indexed files of is removed not sure why ?

Can anyone please help me with this ?

I tried several times to reach lily-developer form but no luck .


Reply all
Reply to author
Forward
0 new messages