Zookeer closing client connections frequently

1,721 views
Skip to first unread message

sit...@gmail.com

unread,
Nov 4, 2015, 9:53:48 AM11/4/15
to Druid User
Hi,
We are running a druid cluster. We are using zookeeper version 3.4.6 and Druid release 0.8.1. We have been seeing data loss during ingestion and whenever the data loss happens, we see the following exception in zookeeper logs.

2015-11-04 06:30:33,075 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception
EndOfStreamException: Unable to read additional data from client sessionid 0x350d2ab4ab40005, likely client has closed socket
        at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
        at java.lang.Thread.run(Thread.java:744)
2015-11-04 06:30:33,075 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /10.74.202.106:59651 which had sessionid 0x350d2ab4ab40005

After googling, we found this problem to be common with ZK version 3.4.6. What is the recommended ZK version for use with Druid 0.8.1?

Thanks,
Sithik

Fangjin Yang

unread,
Nov 7, 2015, 1:12:08 PM11/7/15
to Druid User
Most folks use 2.4.6 in production. How often do you guys see ZK disconnects? There's some useful information online about keeping ZK stable: 
http://druid.io/docs/latest/configuration/zookeeper.html

Fangjin Yang

unread,
Nov 7, 2015, 1:12:20 PM11/7/15
to Druid User
Typo: 3.4.6
Reply all
Reply to author
Forward
0 new messages