Which service uses the hbase ip address and which uses the zookeeper ip address?

[David Montgomery]

Hi,

I am getting this in the logs ......how do I deal with hbase and zookeeper...does titan want the zookeeper address or the hbase address? 
I mean.....titan and rexster are trying to connect to ZK ports.  All great except where is that in the docs?  Rexster use hbase machine address?  my titan server uses zookeraddress>


Which service uses the hbase ip address and which uses the zookeeper ip address?



properties file

storage.backend=hbase
storage.hostname=<%="#{@hbase_host.join(",")}"%>s
cache.db-cache = true
cache.db-cache-clean-wait = 20
cache.db-cache-time = 180000
cache.db-cache-size = 0.5


rexster prop file

storage.index.search.backend=elasticsearch
storage.index.search.client-only=true
storage.index.search.hostname=<%=@elasticsearch_host%>
<graphs>
        <graph>
            <graph-name>graph</graph-name>
            <graph-type>com.thinkaurelius.titan.tinkerpop.rexster.TitanGraphConfiguration</graph-type>
            <!-- <graph-location>/tmp/titan</graph-location> -->
            <graph-read-only>false</graph-read-only>
            <properties>
                <storage.backend>hbase</storage.backend>
                <storage.hostname><%="#{@hbase_host.join(",")}"%></storage.hostname>
                <storage.index.search.backend>elasticsearch</storage.index.search.backend>
                <storage.index.search.hostname><%=@elasticsearch_host%></storage.index.search.hostname>
                <storage.index.search.client-only>false</storage.index.search.client-only>
                <storage.index.search.local-mode>true</storage.index.search.local-mode>
            </properties>
            <extensions>
              <allows>
                <allow>tp:gremlin</allow>
              </allows>
            </extensions>
        </graph>
    </graphs>




    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
9419 [main-SendThread(107.170.236.46:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server 107.170.236.46/107.170.236.46:2181. Will not attempt to authenticate using SASL (unknown error)
9421 [main-SendThread(107.170.236.46:2181)] WARN  org.apache.zookeeper.ClientCnxn  - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
9521 [main] WARN  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  - Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
9522 [main] INFO  org.apache.hadoop.hbase.util.RetryCounter  - Sleeping 8000ms before retry #3...
10522 [main-SendThread(107.170.236.46:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server 107.170.236.46/107.170.236.46:2181. Will not attempt to authenticate using SASL (unknown error)
10524 [main-SendThread(107.170.236.46:2181)] WARN  org.apache.zookeeper.ClientCnxn  - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
11625 [main-SendThread(107.170.236.46:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server 107.170.236.46/107.170.236.46:2181. Will not attempt to authenticate using SASL (unknown error)
11628 [main-SendThread(107.170.236.46:2181)] WARN  org.apache.zookeeper.ClientCnxn  - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)

[John]

Hello David,

I suppose you meant ip addresses because both hbase and zookeeper are distributed.

AFAIK the only ip/port you need to worry about is that of zookeeper cluster. But you need to make sure that your client (eg titan) has access to each of hbase region servers with the appropriate ports open (see hbase doc)

I see you are getting errors when attempting to connect to your zk cluster. The easiest way to diagnose connectivity issues is to use 4 letters words commands (see zk doc), you should try:

$ echo ruok | nc 107.170.236.46 2181

=> should return imok

Cheers

John

[David Montgomery]

Thanks

For those at Aurelius.....

On this page: https://github.com/thinkaurelius/titan/wiki/Using-HBase

It would be great if it can be made more explicit to use zookeeper IP address rather than the below.  The below mentions to use HBase IP address.  Not zookeeper.

storage.hostname

Comma separated list of IP addresses or hostnames of the HBase cluster nodes that this Titan instance connects to

IP addresses or hostnames. Leave empty to connect to localhost.

–

Titan with HBase is now working remote.

See Ya