Connecting Druid node to remote zookeeper

1,142 views
Skip to first unread message

Fafnir Crow

unread,
Jan 21, 2016, 1:13:15 PM1/21/16
to Druid User
I'm trying to set up my first production druid cluster using AWS and have a zookeeper ensemble running, trying to start the coordinator node and getting the following error:

2016-01-21T18:04:33,198 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2016-01-21T18:04:33,198 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.ConnectException: Connection refused

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.7.0_91]

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) ~[?:1.7.0_91]

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) ~[zookeeper-3.4.6.jar:3.4.6-1569965]

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) [zookeeper-3.4.6.jar:3.4.6-1569965]


It looks like its trying to connect to a local zookeeper as opposed to the ensemble paths as listed in my common.runtime.properties


# Zookeeper

druid.zk.service.host="zk1.example.com","zk2.example.com","zk3.example.com" //anonomyized domain name



Any clue what im missing?

Gian Merlino

unread,
Jan 21, 2016, 1:49:39 PM1/21/16
to druid...@googlegroups.com
You don't need the quotes, so try doing just:


If that doesn't work, then your Druid nodes are probably not reading the common.runtime.properties. Make sure that a directory containing it is on the classpath.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/03194e83-8daa-4212-a3d3-935090979fcf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Fafnir Crow

unread,
Jan 21, 2016, 1:52:58 PM1/21/16
to druid...@googlegroups.com
That did it! Appreciate the help. Now I just have to figure out the rest of my problems. 

Fafnir Crow
940-390-2665

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/peCG-ULf0H4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

azam ahmadloo

unread,
Jun 17, 2019, 1:25:07 AM6/17/19
to Druid User
Hi

I wanna to know that is historical process get coordinator IP from zookeeper in a cluster?
In my cluster all nodes cant find Master server IP and use 127.0.0.1 for them.

Can you help to troubleshoot my cluster?




On Thursday, January 21, 2016 at 10:19:39 PM UTC+3:30, Gian Merlino wrote:
You don't need the quotes, so try doing just:


If that doesn't work, then your Druid nodes are probably not reading the common.runtime.properties. Make sure that a directory containing it is on the classpath.

Gian

On Thu, Jan 21, 2016 at 10:13 AM, Fafnir Crow <fafni...@gmail.com> wrote:
I'm trying to set up my first production druid cluster using AWS and have a zookeeper ensemble running, trying to start the coordinator node and getting the following error:

2016-01-21T18:04:33,198 INFO [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2016-01-21T18:04:33,198 WARN [main-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

java.net.ConnectException: Connection refused

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.7.0_91]

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) ~[?:1.7.0_91]

at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) ~[zookeeper-3.4.6.jar:3.4.6-1569965]

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) [zookeeper-3.4.6.jar:3.4.6-1569965]


It looks like its trying to connect to a local zookeeper as opposed to the ensemble paths as listed in my common.runtime.properties


# Zookeeper

druid.zk.service.host="zk1.example.com","zk2.example.com","zk3.example.com" //anonomyized domain name



Any clue what im missing?

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid...@googlegroups.com.

Sashidhar Thallam

unread,
Jun 17, 2019, 3:24:09 AM6/17/19
to druid...@googlegroups.com
Hi,

Can you check these paths in your Zookeeper {druid.zk.paths.coordinatorPath}/_COORDINATOR or {druid.zk.paths.base}/_COORDINATOR.  
You can find the value for druid.zk.paths.base in your common.runtime.properties. 

Thanks,
Sashi

To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

azam ahmadloo

unread,
Jun 17, 2019, 6:02:04 AM6/17/19
to Druid User
Thank you.

My problem solved. :) This is my first druid installation and I have just one zookeeper running on Master server.

I started zookeeper on all nodes and the error gone.


Reply all
Reply to author
Forward
0 new messages