I have been battling with this error during the last days. I wonder if someone could be of any help.
I downloaded, properly configured the hbase-indexer with my HBase 1.1.2 and both Solr 4.10.4 and Solr 5.21
Then, I tried the tutorial, started the hbase-indexer server just fine, and created an indexer without problems:
hbase-indexer add-indexer -n myindexer -c ~/Desktop/indexdemo-indexer.xml -cp solr.zk=master-VirtualBox:2181/solr -cp solr.collection=sofiacollection44 -z master-VirtualBox
But when trying adding to HBase, something like
put 'indexdemo-user', 'row2', 'info:lastname', 'Smith'
I get the following error
15/11/29 14:41:41 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=master-VirtualBox:2181/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1bfba398
15/11/29 14:41:41 INFO cloud.ConnectionManager: Waiting for client to connect to ZooKeeper
15/11/29 14:41:41 INFO zookeeper.ClientCnxn: Opening socket connection to server master-VirtualBox/192.168.1.44:2181. Will not attempt to authenticate using SASL (unknown error)
15/11/29 14:41:41 INFO zookeeper.ClientCnxn: Socket connection established to master-VirtualBox/192.168.1.44:2181, initiating session
15/11/29 14:41:41 INFO zookeeper.ClientCnxn: Session establishment complete on server master-VirtualBox/192.168.1.44:2181, sessionid = 0x100004feb5900d0, negotiated timeout = 30000
15/11/29 14:41:41 INFO cloud.ConnectionManager: Watcher org.apache.solr.common.cloud.ConnectionManager@1bfba398 name:ZooKeeperConnection Watcher:master-VirtualBox:2181/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
15/11/29 14:41:41 INFO cloud.ConnectionManager: Client is connected to ZooKeeper
15/11/29 14:41:41 INFO cloud.SolrZkClient: makePath: /clusterstate.json
15/11/29 14:41:41 ERROR impl.SepEventExecutor: Error while processing event
java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:102)
at com.ngdata.sep.impl.SepEventExecutor$1.run(SepEventExecutor.java:97)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:168)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:185)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54)
at com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter.add(DirectSolrInputDocumentWriter.java:104)
at com.ngdata.hbaseindexer.indexer.Indexer.indexRowData(Indexer.java:156)
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:99)
... 6 more
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /clusterstate.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:407)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:404)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:361)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:348)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:335)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:96)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:86)
at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:196)
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:161)
... 13 more
15/11/29 14:41:41 WARN impl.SepConsumer: Error processing a batch of SEP events, the error will be forwarded to HBase for retry
java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at com.ngdata.sep.impl.SepConsumer.waitOnSepEventCompletion(SepConsumer.java:282)
at com.ngdata.sep.impl.SepConsumer.replicateWALEntry(SepConsumer.java:263)
at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20176)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:102)
at com.ngdata.sep.impl.SepEventExecutor$1.run(SepEventExecutor.java:97)
... 5 more
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:168)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:185)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54)
at com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter.add(DirectSolrInputDocumentWriter.java:104)
at com.ngdata.hbaseindexer.indexer.Indexer.indexRowData(Indexer.java:156)
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:99)
... 6 more
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /clusterstate.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:407)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:404)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:361)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:348)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:335)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:96)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:86)
at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:196)
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:161)
... 13 more
15/11/29 14:41:41 ERROR impl.SepConsumer: Encountered exceptions on 1 batches (out of 1 total batches)
15/11/29 14:41:41 ERROR ipc.RpcServer: Unexpected throwable object
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at com.ngdata.sep.impl.SepConsumer.waitOnSepEventCompletion(SepConsumer.java:297)
at com.ngdata.sep.impl.SepConsumer.replicateWALEntry(SepConsumer.java:263)
at org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:20176)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108)
at org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at com.ngdata.sep.impl.SepConsumer.waitOnSepEventCompletion(SepConsumer.java:282)
... 10 more
Caused by: java.lang.RuntimeException: org.apache.solr.common.cloud.ZooKeeperException:
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:102)
at com.ngdata.sep.impl.SepEventExecutor$1.run(SepEventExecutor.java:97)
... 5 more
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:168)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:185)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54)
at com.ngdata.hbaseindexer.indexer.DirectSolrInputDocumentWriter.add(DirectSolrInputDocumentWriter.java:104)
at com.ngdata.hbaseindexer.indexer.Indexer.indexRowData(Indexer.java:156)
at com.ngdata.hbaseindexer.indexer.IndexingEventListener.processEvents(IndexingEventListener.java:99)
... 6 more
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /clusterstate.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:407)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:404)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:361)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:348)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:335)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:96)
at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:86)
at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:196)
at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:161)
... 13 more
I understand it is a zookeeper issue, but when I connect to the zookeeper I can see and read the /clusterstate.json
Initially I thought it was a Solr 5.x problem as I saw that the /clusterstate.json is not used anymore, but with Solr 4.x I keep getting the same error.