Scalding Spyglass HBase connection issue
Deepika Khera
class SimpleHBaseSourceExample(args: Args) extends JobBase(args) with HBasePipeConversions {
val output = args("output")
val hbs = new HBaseSource(
"deepika_test",
"zookeeperhost:2181",
new Fields("key"),
List("cf"),
List(new Fields("name")),
sourceMode = SourceMode.GET_LIST, keyList = List("1", "2", "3"))
.read
.fromBytesWritable(new Fields("key", "name"))
.write(Tsv(output format "get_list"))
}
When I run my job, it seems to be able to connect to zookeeper, but then stalls for the time. At the end it throws an exception. Please see logs below:
15/06/26 23:05:34 INFO zookeeper.ClientCnxn: Session establishment complete on server zookeeperhost/1.2.3.4:2181, sessionid = 0x24db7c727c200a2, negotiated timeout = 30000
15/06/26 23:06:02 INFO util.Update: newer Cascading release available: 2.6.3
15/06/26 23:16:14 ERROR hbase.HBaseInputFormatBase: ************* HBase table deepika_test is not accessible
15/06/26 23:16:14 ERROR hbase.HBaseInputFormatBase: org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for deepika_test,,99999999999999 after 10 tries.
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:980)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:885)
The zookeeper logs at this time show the following errors:
2015-06-26 23:08:01,649 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /1.2.3.4:42460 (no session established for client)
2015-06-26 23:09:01,661 - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /1.2.3.4:42515
2015-06-26 23:09:01,662 - WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception
EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:745)
Would appreciate any help or pointers on this?
Thanks,
Deepika
Koert Kuipers
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for deepika_test
looks like an issue with your hbase installation to me, not a scalding/spyglass issue. can you read from that table using hbase shell?
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/0e45f6a9-0a9c-4fc7-b65e-676ce37e8caa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Deepika
Sent from my iPhone
You received this message because you are subscribed to a topic in the Google Groups "cascading-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cascading-user/KOAVB1knsJA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/CANx3uAh9NiYL1rJSCTUBs1Voo5Abne-JWS7p-Y5nhFhks0EtmA%40mail.gmail.com.
