Unexpected exception while invoking in nimbus

432 views
Skip to first unread message

sushma shankar

unread,
Jul 20, 2012, 1:53:06 AM7/20/12
to storm...@googlegroups.com
Hi Nathan,
 
Am facing problem in viewing the storm ui..it is just blank, and in the nimbus log i found this, but the topologies are running fine..earlier i was able to see the ui..
 

2012-07-20 09:23:15 ZooKeeper [INFO] Client environment:user.name=user1

2012-07-20 09:23:15 ZooKeeper [INFO] Client environment:user.home=/home/user1

2012-07-20 09:23:15 ZooKeeper [INFO] Client environment:user.dir=/home/user1/installations/storm

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:host.name=hostanme

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:java.io.tmpdir=/tmp

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:java.compiler=<NA>

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:os.name=Linux

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:os.arch=amd64

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:os.version=2.6.18-194.el5

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:user.name=user1

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:user.home=/home/user1

2012-07-20 09:23:15 ZooKeeperServer [INFO] Server environment:user.dir=/home/user1/installations/storm

2012-07-20 09:23:16 nimbus [INFO] Starting Nimbus with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 5000, "topology.skip.missing.kryo.registrations" false, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "drpc.servers" "ipadress", "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/mnt/storm", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "nimbus.host" "ipadress", "storm.zookeeper.port" 2181, "transactional.zookeeper.port" nil, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["ipadress"], "transactional.zookeeper.root" "/transactional", "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "distributed", "topology.optimize" true, "topology.max.task.parallelism" nil}

2012-07-20 09:23:16 CuratorFrameworkImpl [INFO] Starting

2012-07-20 09:23:16 ZooKeeper [INFO] Initiating client connection, connectString=ipaddress:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@5893bca2

2012-07-20 09:23:16 ClientCnxn [INFO] Opening socket connection to server /ipaddress:2181

2012-07-20 09:23:16 ClientCnxn [INFO] Socket connection established to hostname/ipadress:2181, initiating session

2012-07-20 09:23:16 ClientCnxn [INFO] Session establishment complete on server hostname/ipaddress:2181, sessionid = 0x137a13fe1fc021a, negotiated timeout = 20000

2012-07-20 09:23:16 zookeeper [INFO] Zookeeper state update: :connected:none

2012-07-20 09:23:16 ZooKeeper [INFO] Session: 0x137a13fe1fc021a closed

2012-07-20 09:23:16 CuratorFrameworkImpl [INFO] Starting

2012-07-20 09:23:16 ZooKeeper [INFO] Initiating client connection, connectString=ipaddress:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@23faa614

2012-07-20 09:23:16 ClientCnxn [INFO] EventThread shut down

2012-07-20 09:23:16 ClientCnxn [INFO] Opening socket connection to server /ipaddrss:2181

2012-07-20 09:23:16 ClientCnxn [INFO] Socket connection established to hostname/ipaddress:2181, initiating session

2012-07-20 09:23:16 ClientCnxn [INFO] Session establishment complete on server hostname/ipaddress:2181, sessionid = 0x137a13fe1fc021b, negotiated timeout = 20000

2012-07-20 09:23:16 nimbus [INFO] Starting Nimbus server...

2012-07-20 09:23:21 TNonblockingServer [ERROR] Unexpected exception while invoking!

java.lang.RuntimeException: java.lang.NullPointerException

at clojure.lang.LazySeq.sval(LazySeq.java:47)

at clojure.lang.LazySeq.seq(LazySeq.java:56)

at clojure.lang.RT.seq(RT.java:450)

at clojure.core$seq.invoke(core.clj:122)

at clojure.core$dorun.invoke(core.clj:2450)

at clojure.core$doall.invoke(core.clj:2465)

at backtype.storm.daemon.nimbus$fn__3108$exec_fn__1021__auto__$reify__3126.getClusterInfo(nimbus.clj:770)

at backtype.storm.generated.Nimbus$Processor$getClusterInfo.getResult(Nimbus.java:1223)

at backtype.storm.generated.Nimbus$Processor$getClusterInfo.getResult(Nimbus.java:1212)

at org.apache.thrift7.ProcessFunction.process(ProcessFunction.java:32)

at org.apache.thrift7.TBaseProcessor.process(TBaseProcessor.java:34)

at org.apache.thrift7.server.TNonblockingServer$FrameBuffer.invoke(TNonblockingServer.java:632)

at org.apache.thrift7.server.THsHaServer$Invocation.run(THsHaServer.java:201)

at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

at java.lang.Thread.run(Thread.java:662)

Caused by: java.lang.NullPointerException

at clojure.core$name.invoke(core.clj:1245)

at backtype.storm.daemon.nimbus$extract_status_str.invoke(nimbus.clj:555)

at backtype.storm.daemon.nimbus$fn__3108$exec_fn__1021__auto__$reify__3126$iter__3152__3156$fn__3157.invoke(nimbus.clj:782)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

... 15 more

 

and in the ui log..

Started SocketC...@0.0.0.0:8080

2012-07-20 09:20:49 log [WARN] /

org.apache.thrift7.transport.TTransportException

at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)

at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)

at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)

at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)

at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)

at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)

at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)

at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)

at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)

at backtype.storm.generated.Nimbus$Client.recv_getClusterInfo(Nimbus.java:384)

at backtype.storm.generated.Nimbus$Client.getClusterInfo(Nimbus.java:372)

at backtype.storm.ui.core$main_page.invoke(core.clj:123)

at backtype.storm.ui.core$fn__6688.invoke(core.clj:665)

at compojure.core$if_route$fn__5320.invoke(core.clj:39)

at compojure.core$if_method$fn__5313.invoke(core.clj:24)

at compojure.core$routing$fn__5335.invoke(core.clj:98)

at clojure.core$some.invoke(core.clj:2053)

at compojure.core$routing.doInvoke(core.clj:98)

at clojure.lang.RestFn.applyTo(RestFn.java:140)

at clojure.core$apply.invoke(core.clj:542)

at compojure.core$routes$fn__5339.invoke(core.clj:103)

at ring.middleware.keyword_params$wrap_keyword_params$fn__5831.invoke(keyword_params.clj:21)

at ring.middleware.nested_params$wrap_nested_params$fn__5868.invoke(nested_params.clj:64)

at ring.middleware.params$wrap_params$fn__5808.invoke(params.clj:76)

at ring.middleware.multipart_params$wrap_multipart_params$fn__5886.invoke(multipart_params.clj:80)

at ring.middleware.session$wrap_session$fn__6038.invoke(session.clj:40)

at ring.middleware.cookies$wrap_cookies$fn__5977.invoke(cookies.clj:132)

at ring.adapter.jetty$proxy_handler$fn__6219.invoke(jetty.clj:16)

at ring.adapter.jetty.proxy$org.mortbay.jetty.handler.AbstractHandler$0.handle(Unknown Source)

at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)

at org.mortbay.jetty.Server.handle(Server.java:326)

at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)

at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)

at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)

at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)

at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)

at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)

at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2012-07-20 09:21:50 log [WARN] /


 

Nathan Marz

unread,
Jul 20, 2012, 5:49:09 AM7/20/12
to storm...@googlegroups.com
What version of Storm?
--
Twitter: @nathanmarz
http://nathanmarz.com

Allan Carroll

unread,
Aug 27, 2012, 7:19:03 PM8/27/12
to storm...@googlegroups.com
I'm seeing the same exception today. Storm 0.6.2

Nathan Marz

unread,
Aug 27, 2012, 7:19:57 PM8/27/12
to storm...@googlegroups.com
You're using a very old version of Storm. Upgrade to 0.8.0 which fixes this.

Allan Carroll

unread,
Aug 27, 2012, 7:39:42 PM8/27/12
to storm...@googlegroups.com
We've been planning on it. Any suggestions about a workaround while we upgrade? Should resetting zookeeper data help?

Nathan Marz

unread,
Aug 28, 2012, 12:20:22 AM8/28/12
to storm...@googlegroups.com
Yea, the easiest fix is to reset ZK.
Reply all
Reply to author
Forward
0 new messages