rexster logs and zookeeper issues

[David Montgomery]

.  Hi,

I am using CDH 5 hbase, ZK, and yarn in pseudo mode with ES 1.2.1 on a VM with Ubuntu 12.04.  Also usig rexster.

 curl localhost:8182/graphs
{"version":"2.5.0","name":"Rexster: A Graph Server","graphs":["graph"],"queryTime":0.17022,"upTime":"0[d]:02[h]:04[m]:22[s]"}



When I look at the logs I get a never ending stream of the below.  Why does that happen?  Should I be seeing this?  Is this normal behavior? If not then how do I resolved?

Here is my zoo.cfg

maxClientCnxns=50
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
dataDir=/var/lib/zookeeper
# the port at which the clients will connect
clientPort=2181


Here is my titan-hbase-es.properties

storage.backend=hbase
storage.hostname=127.0.0.1
#storage.port=2181
cache.db-cache = false
index.search.backend=elasticsearch
index.search.hostname=localhost
index.search.elasticsearch.client-only=true
index.search.elasticsearch.local-mode=false

Here is the graph portion of rexster-hbase-es.xml

<graphs>
        <graph>
            <graph-name>graph</graph-name>
            <graph-type>com.thinkaurelius.titan.tinkerpop.rexster.TitanGraphConfiguration</graph-type>
            <!-- <graph-location>/tmp/titan</graph-location> -->
            <graph-read-only>false</graph-read-only>
            <properties>
                <storage.backend>hbase</storage.backend>
                <index.search.backend>elasticsearch</index.search.backend>
                <index.search.hostname>localhost</index.search.hostname>
                <index.search.client-only>true</index.search.client-only>
            </properties>
            <extensions>
              <allows>
                <allow>tp:gremlin</allow>
              </allows>
            </extensions>
        </graph>



Thanks
7202800 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation  - Closing zookeeper sessionid=0x148c12d903b18d5
7202802 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Session: 0x148c12d903b18d5 closed
7202802 [pool-4-thread-1-EventThread] INFO  org.apache.zookeeper.ClientCnxn  - EventThread shut down
7207906 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x4e31cead, quorum=localhost:2181, baseZNode=/hbase
7207908 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
7207909 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Socket connection established to localhost/127.0.0.1:2181, initiating session
7207910 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  - Process identifier=hconnection-0x4e31cead connecting to ZooKeeper ensemble=localhost:2181
7207913 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x148c12d903b18d6, negotiated timeout = 40000
7207915 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=catalogtracker-on-hconnection-0x4e31cead, quorum=localhost:2181, baseZNode=/hbase
7207915 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
7207916 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Socket connection established to localhost/127.0.0.1:2181, initiating session
7207918 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  - Process identifier=catalogtracker-on-hconnection-0x4e31cead connecting to ZooKeeper ensemble=localhost:2181
7207920 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x148c12d903b18d7, negotiated timeout = 40000
7207925 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation  - Closing zookeeper sessionid=0x148c12d903b18d6
7207927 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Session: 0x148c12d903b18d6 closed
7207927 [pool-4-thread-1-EventThread] INFO  org.apache.zookeeper.ClientCnxn  - EventThread shut down
7208031 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Session: 0x148c12d903b18d7 closed
7208032 [pool-4-thread-1-EventThread] INFO  org.apache.zookeeper.ClientCnxn  - EventThread shut down
7208036 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x6d772ebb, quorum=localhost:2181, baseZNode=/hbase
7208037 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
7208038 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Socket connection established to localhost/127.0.0.1:2181, initiating session
7208039 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  - Process identifier=hconnection-0x6d772ebb connecting to ZooKeeper ensemble=localhost:2181
7208040 [pool-4-thread-1-SendThread(localhost:2181)] INFO  org.apache.zookeeper.ClientCnxn  - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x148c12d903b18d8, negotiated timeout = 40000
7208054 [pool-4-thread-1] INFO  org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation  - Closing zookeeper sessionid=0x148c12d903b18d8
7208055 [pool-4-thread-1] INFO  org.apache.zookeeper.ZooKeeper  - Session: 0x148c12d903b18d8 closed
7208056 [pool-4-thread-1-EventThread] INFO  org.apache.zookeeper.ClientCnxn  - EventThread shut down

[Rob Townley]

I get exactly the same thing, did you manage to find out how to suppress these messages?

[Jason Plurad]

If you are using `rexster.sh` out of the box from Titan, update the `$TITAN_HOME/rexhome/log4.properties` with

log4j.logger.org.apache.zookeeper=WARN
log4j.logger.org.apache.hadoop.hbase.client=WARN
log4j.logger.org.apache.hadoop.hbase.zookeeper=WARN