Realtime woes

116 views
Skip to first unread message

David Montgomery

unread,
Jun 8, 2013, 12:02:49 AM6/8/13
to druid-de...@googlegroups.com
HI



1) I have zookeeper running and initialized

2) In my real-time node log files I get the below errors when starting the realtime node.  Why will the realtime node not work with a running zookeeper?

How do I reslove?




2013-06-08 03:52:25,642 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.druid.realtime.ZkSegmentAnnouncer.start()] on object[com.metamx.druid.realtime.ZkSegmentAnnouncer@5c3383eb].
2013-06-08 03:52:25,642 INFO [main] com.metamx.druid.realtime.ZkSegmentAnnouncer - Starting zkCoordinator for server[127.0.0.1:8031] with config[com.metamx.druid.realtime.ZkSegmentAnnouncerConfig$$EnhancerByCGLIB$$260f6eb5@3a19e897]
2013-06-08 03:52:26,399 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.HttpClient.start()] on object[com.metamx.http.client.HttpClient@1034fc46].
2013-06-08 03:52:26,419 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@293ed714].
2013-06-08 03:52:26,419 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2013-06-08 03:52:26,436 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.druid.realtime.RealtimeManager.start() throws java.io.IOException] on object[com.metamx.druid.realtime.RealtimeManager@7fbf04$
2013-06-08 03:52:26,437 INFO [main] com.metamx.druid.realtime.RealtimeManager - Calling the FireDepartment and getting a Firehose.
2013-06-08 03:52:26,467 INFO [PhoneBook--0] com.metamx.druid.client.ClientInventoryManager - New inventory container[127.0.0.1:8093]!
2013-06-08 03:52:26,480 INFO [PhoneBook--0] com.metamx.druid.client.ClientInventoryManager - Putting watch on [/druid/servedSegmentsPath/127.0.0.1:8093]
2013-06-08 03:52:26,508 INFO [PhoneBook--0] com.metamx.druid.client.ClientInventoryManager - New inventory container[127.0.0.1:8031]!
2013-06-08 03:52:26,520 INFO [PhoneBook--0] com.metamx.druid.client.ClientInventoryManager - Putting watch on [/druid/servedSegmentsPath/127.0.0.1:8031]
2013-06-08 03:52:27,798 INFO [main] kafka.consumer.ZookeeperConsumerConnector - topic-pixel-local_ip-10-143-14-39.ap-southeast-1.compute.internal-1370663547525-33d8c5ce Connecting to zookeeper instance at localhost:2181
2013-06-08 03:52:27,806 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTimeout=15000 watcher=org.I0Itec.zkclient.ZkClient@39301cdb
2013-06-08 03:52:27,812 INFO [ZkClient-EventThread-18-localhost:2181] org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread.
2013-06-08 03:52:27,824 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2013-06-08 03:52:27,828 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2013-06-08 03:52:27,828 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
2013-06-08 03:52:29,852 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2013-06-08 03:52:29,853 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2013-06-08 03:52:29,855 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
        at sun.nio.ch.IOUtil.read(IOUtil.java:193)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2013-06-08 03:52:31,616 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2013-06-08 03:52:31,617 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2013-06-08 03:52:31,618 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
        at sun.nio.ch.IOUtil.read(IOUtil.java:193)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2013-06-08 03:52:33,264 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2013-06-08 03:52:33,264 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2013-06-08 03:52:33,265 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
        at sun.nio.ch.IOUtil.read(IOUtil.java:193)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2013-06-08 03:52:34,569 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2013-06-08 03:52:34,570 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2013-06-08 03:52:34,571 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method)



David Montgomery

unread,
Jun 8, 2013, 5:09:09 AM6/8/13
to druid-de...@googlegroups.com
Resolved.  My bad with a ZK config file unrelated to druid.
Reply all
Reply to author
Forward
0 new messages