Storm-starter problems

287 views

Skip to first unread message

Brent

unread,

Dec 8, 2013, 1:28:00 PM12/8/13

to storm...@googlegroups.com

Hi everyone,

Just wondering if anyone can help me with a problem I'm having. I have just started looking at storm and I'm trying to get a distributed cluster running following this guide

http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/

I have one zookeeper node one nimbus node and a slave node all on centos 6.4

storm version 0.85

0mq version 2.1.7

jzmq version 2.1.0 (not sure if I need this, I missed it first time round in the instructions but installed it after the cluster was up and running)

java version 1.7.0_45

They are all running fine I believe and I can log into the ui and view the state of the cluster

The problem starts when I try to upload a topology

I run the following commands on the nimbus node after cloning the storm-starter repo

lein deps

lein compile

lein uberjar

then

usr/local/storm/bin/storm jar target/storm-starter-0.0.1-SNAPSHOT-standalone.jar storm.starter.ExclamationTopology (which i think is some kind of local test run)

it seems to execute fine with output such as:

1361 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor with id 356bf018-efb7-4ddc-a43f-6cb9a318cca9 at host nimbus1-1.net

1508 [main] INFO backtype.storm.daemon.nimbus - Received topology submission for test with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" 1, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "test", "storm.id" "test-1-1386525508", "topology.debug" true}

1561 [main] INFO backtype.storm.daemon.nimbus - Activating test: test-1-1386525508

1792 [main] INFO backtype.storm.scheduler.EvenScheduler - Available slots: (["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 5] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 6] ["da8f7449-0954-460a-b52d-fe0adc045087" 1] ["da8f7449-0954-460a-b52d-fe0adc045087" 2] ["da8f7449-0954-460a-b52d-fe0adc045087" 3])

1893 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment for topology id test-1-1386525508: #backtype.storm.daemon.common.Assignment{:master-code-dir "/tmp/ca5857a0-65e5-4eb9-9aba-d5c90c1cc9c7/nimbus/stormdist/test-1-1386525508", :node->host {"356bf018-efb7-4ddc-a43f-6cb9a318cca9" "nimbus1-1.net"}, :executor->node+port {[2 2] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [3 3] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [4 4] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [5 5] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [6 6] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [7 7] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [8 8] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [9 9] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [10 10] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [11 11] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [12 12] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [13 13] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [14 14] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [15 15] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [16 16] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4], [1 1] ["356bf018-efb7-4ddc-a43f-6cb9a318cca9" 4]}, :executor->start-time-secs {[2 2] 1386525508, [3 3] 1386525508, [4 4] 1386525508, [5 5] 1386525508, [6 6] 1386525508, [7 7] 1386525508, [8 8] 1386525508, [9 9] 1386525508, [10 10] 1386525508, [11 11] 1386525508, [12 12] 1386525508, [13 13] 1386525508, [14 14] 1386525508, [15 15] 1386525508, [16 16] 1386525508, [1 1] 1386525508}}

2280 [Thread-8] INFO backtype.storm.daemon.supervisor - Downloading code for storm id test-1-1386525508 from /tmp/ca5857a0-65e5-4eb9-9aba-d5c90c1cc9c7/nimbus/stormdist/test-1-1386525508

2822 [Thread-8] INFO backtype.storm.daemon.supervisor - Extracting resources from jar at target/storm-starter-0.0.1-SNAPSHOT-standalone.jar to /tmp/7d20a45c-8ea9-405c-8183-ba10cd37cc7a/supervisor/stormdist/test-1-1386525508/resources

2911 [Thread-8] INFO backtype.storm.daemon.supervisor - Finished downloading code for storm id test-1-1386525508 from /tmp/ca5857a0-65e5-4eb9-9aba-d5c90c1cc9c7/nimbus/stormdist/test-1-1386525508

2978 [Thread-9] INFO backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "test-1-1386525508", :executors ([2 2] [3 3] [4 4] [5 5] [6 6] [7 7] [8 8] [9 9] [10 10] [11 11] [12 12] [13 13] [14 14] [15 15] [16 16] [1 1])} for this supervisor 356bf018-efb7-4ddc-a43f-6cb9a318cca9 on port 4 with id bcaabef2-0dce-4b32-a635-378511c1ae3c

2987 [Thread-9] INFO backtype.storm.daemon.worker - Launching worker for test-1-1386525508 on 356bf018-efb7-4ddc-a43f-6cb9a318cca9:4 with id bcaabef2-0dce-4b32-a635-378511c1ae3c and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/tmp/7d20a45c-8ea9-405c-8183-ba10cd37cc7a", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}

2988 [Thread-9] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting

3002 [Thread-9-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none

3007 [Thread-9] INFO com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting

3335 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor exclaim1:[2 2]

3345 [Thread-9] INFO backtype.storm.daemon.task - Emitting: exclaim1 __system ["startup"]

3346 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks exclaim1:[2 2]

3367 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor exclaim1:[2 2]

3367 [Thread-18] INFO backtype.storm.daemon.executor - Preparing bolt exclaim1:(2)

3378 [Thread-18] INFO backtype.storm.daemon.executor - Prepared bolt exclaim1:(2)

3383 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor exclaim1:[3 3]

3383 [Thread-9] INFO backtype.storm.daemon.task - Emitting: exclaim1 __system ["startup"]

3384 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks exclaim1:[3 3]

3386 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor exclaim1:[3 3]

3387 [Thread-20] INFO backtype.storm.daemon.executor - Preparing bolt exclaim1:(3)

3389 [Thread-20] INFO backtype.storm.daemon.executor - Prepared bolt exclaim1:(3)

3401 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor exclaim1:[4 4]

3402 [Thread-9] INFO backtype.storm.daemon.task - Emitting: exclaim1 __system ["startup"]

3403 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks exclaim1:[4 4]

3407 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor exclaim1:[4 4]

3407 [Thread-22] INFO backtype.storm.daemon.executor - Preparing bolt exclaim1:(4)

3408 [Thread-22] INFO backtype.storm.daemon.executor - Prepared bolt exclaim1:(4)

3420 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor exclaim2:[5 5]

3421 [Thread-9] INFO backtype.storm.daemon.task - Emitting: exclaim2 __system ["startup"]

3422 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks exclaim2:[5 5]

3426 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor exclaim2:[5 5]

3426 [Thread-24] INFO backtype.storm.daemon.executor - Preparing bolt exclaim2:(5)

3427 [Thread-24] INFO backtype.storm.daemon.executor - Prepared bolt exclaim2:(5)

3441 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor exclaim2:[6 6]

3442 [Thread-9] INFO backtype.storm.daemon.task - Emitting: exclaim2 __system ["startup"]

3442 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks exclaim2:[6 6]

3446 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor exclaim2:[6 6]

3446 [Thread-26] INFO backtype.storm.daemon.executor - Preparing bolt exclaim2:(6)

3448 [Thread-26] INFO backtype.storm.daemon.executor - Prepared bolt exclaim2:(6)

3459 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor word:[7 7]

3460 [Thread-9] INFO backtype.storm.daemon.task - Emitting: word __system ["startup"]

3461 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks word:[7 7]

3468 [Thread-28] INFO backtype.storm.daemon.executor - Opening spout word:(7)

3470 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor word:[7 7]

3471 [Thread-28] INFO backtype.storm.daemon.executor - Opened spout word:(7)

3475 [Thread-28] INFO backtype.storm.daemon.executor - Activating spout word:(7)

3483 [Thread-9] INFO backtype.storm.daemon.executor - Loading executor word:[8 8]

3484 [Thread-9] INFO backtype.storm.daemon.task - Emitting: word __system ["startup"]

3484 [Thread-9] INFO backtype.storm.daemon.executor - Loaded executor tasks word:[8 8]

3488 [Thread-30] INFO backtype.storm.daemon.executor - Opening spout word:(8)

3488 [Thread-9] INFO backtype.storm.daemon.executor - Finished loading executor word:[8 8]

3488 [Thread-30] INFO backtype.storm.daemon.executor - Opened spout word:(8)

So I then try and deploy it to the cluster

/usr/local/storm/bin/storm jar target/storm-starter-0.0.1-SNAPSHOT-standalone.jar storm.starter.ExclamationTopology exclamation-topology (I think the last option trigers it to be uploaded to zookeeper and sent to all attached nodes in the cluster)

when it runs I get the following:

/usr/local/storm/bin/storm jar target/storm-starter-0.0.1-SNAPSHOT-standalone.jar storm.starter.ExclamationTopology exclamation-topology

Running: java -client -Dstorm.options= -Dstorm.home=/usr/local/storm-0.8.2 -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm-0.8.2/storm-0.8.2.jar:/usr/local/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/usr/local/storm-0.8.2/lib/guava-13.0.jar:/usr/local/storm-0.8.2/lib/clout-1.0.1.jar:/usr/local/storm-0.8.2/lib/kryo-2.17.jar:/usr/local/storm-0.8.2/lib/snakeyaml-1.9.jar:/usr/local/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/usr/local/storm-0.8.2/lib/disruptor-2.10.1.jar:/usr/local/storm-0.8.2/lib/jzmq-2.1.0.jar:/usr/local/storm-0.8.2/lib/curator-framework-1.0.1.jar:/usr/local/storm-0.8.2/lib/hiccup-0.3.6.jar:/usr/local/storm-0.8.2/lib/curator-client-1.0.1.jar:/usr/local/storm-0.8.2/lib/commons-lang-2.5.jar:/usr/local/storm-0.8.2/lib/junit-3.8.1.jar:/usr/local/storm-0.8.2/lib/tools.logging-0.2.3.jar:/usr/local/storm-0.8.2/lib/httpcore-4.1.jar:/usr/local/storm-0.8.2/lib/servlet-api-2.5.jar:/usr/local/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/usr/local/storm-0.8.2/lib/compojure-1.1.3.jar:/usr/local/storm-0.8.2/lib/commons-logging-1.1.1.jar:/usr/local/storm-0.8.2/lib/clojure-1.4.0.jar:/usr/local/storm-0.8.2/lib/objenesis-1.2.jar:/usr/local/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/usr/local/storm-0.8.2/lib/clj-time-0.4.1.jar:/usr/local/storm-0.8.2/lib/core.incubator-0.1.0.jar:/usr/local/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/usr/local/storm-0.8.2/lib/jgrapht-0.8.3.jar:/usr/local/storm-0.8.2/lib/ring-core-1.1.5.jar:/usr/local/storm-0.8.2/lib/log4j-1.2.16.jar:/usr/local/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/usr/local/storm-0.8.2/lib/asm-4.0.jar:/usr/local/storm-0.8.2/lib/commons-codec-1.4.jar:/usr/local/storm-0.8.2/lib/httpclient-4.1.1.jar:/usr/local/storm-0.8.2/lib/carbonite-1.5.0.jar:/usr/local/storm-0.8.2/lib/minlog-1.2.jar:/usr/local/storm-0.8.2/lib/commons-exec-1.1.jar:/usr/local/storm-0.8.2/lib/zookeeper-3.3.3.jar:/usr/local/storm-0.8.2/lib/tools.cli-0.2.2.jar:/usr/local/storm-0.8.2/lib/commons-io-1.4.jar:/usr/local/storm-0.8.2/lib/libthrift7-0.7.0.jar:/usr/local/storm-0.8.2/lib/jline-0.9.94.jar:/usr/local/storm-0.8.2/lib/joda-time-2.0.jar:/usr/local/storm-0.8.2/lib/tools.macro-0.1.0.jar:/usr/local/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/usr/local/storm-0.8.2/lib/jetty-util-6.1.26.jar:/usr/local/storm-0.8.2/lib/json-simple-1.1.jar:/usr/local/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/usr/local/storm-0.8.2/lib/jetty-6.1.26.jar:target/storm-starter-0.0.1-SNAPSHOT-standalone.jar:/root/.storm:/usr/local/storm-0.8.2/bin -Dstorm.jar=target/storm-starter-0.0.1-SNAPSHOT-standalone.jar storm.starter.ExclamationTopology exclamation-topology

0 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting jar...

11 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar target/storm-starter-0.0.1-SNAPSHOT-standalone.jar to assigned location: /app/storm/nimbus/inbox/stormjar-0d7bf84a-4bf6-4611-8532-a2a2aa9442ce.jar

97 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded topology jar to assigned location: /app/storm/nimbus/inbox/stormjar-0d7bf84a-4bf6-4611-8532-a2a2aa9442ce.jar

98 [main] INFO backtype.storm.StormSubmitter - Submitting topology exclamation-topology in distributed mode with conf {"topology.workers":3,"topology.debug":true}

Exception in thread "main" java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException

at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:94)

at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:40)

at storm.starter.ExclamationTopology.main(ExclamationTopology.java:59)

Caused by: org.apache.thrift7.transport.TTransportException

at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)

at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)

at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)

at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)

at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)

at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)

at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)

at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)

at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)

at backtype.storm.generated.Nimbus$Client.recv_submitTopology(Nimbus.java:145)

at backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:129)

at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:80)

... 2 more

I think im getting the transport exception because my nimbus process crashes when receiving the topology from zookeper

this is the nimbus log:

2013-12-08 17:55:14 nimbus [INFO] Using default scheduler

2013-12-08 17:55:15 CuratorFrameworkImpl [INFO] Starting

2013-12-08 17:55:15 ZooKeeper [INFO] Initiating client connection, connectString=zoo1-1:2181 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@18f7206d

2013-12-08 17:55:15 ClientCnxn [INFO] Opening socket connection to server zoo1-1/172.16.218.10:2181

2013-12-08 17:55:15 ClientCnxn [INFO] Socket connection established to zoo1-1/172.16.218.10:2181, initiating session

2013-12-08 17:55:15 ClientCnxn [INFO] Session establishment complete on server zoo1-1/172.16.218.10:2181, sessionid = 0x142d358dd410002, negotiated timeout = 20000

2013-12-08 17:55:15 zookeeper [INFO] Zookeeper state update: :connected:none

2013-12-08 17:55:15 ClientCnxn [INFO] EventThread shut down

2013-12-08 17:55:15 ZooKeeper [INFO] Session: 0x142d358dd410002 closed

2013-12-08 17:55:15 CuratorFrameworkImpl [INFO] Starting

2013-12-08 17:55:15 ZooKeeper [INFO] Initiating client connection, connectString=zoo1-1:2181/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@214d554b

2013-12-08 17:55:15 ClientCnxn [INFO] Opening socket connection to server zoo1-1/172.16.218.10:2181

2013-12-08 17:55:15 ClientCnxn [INFO] Socket connection established to zoo1-1/172.16.218.10:2181, initiating session

2013-12-08 17:55:15 ClientCnxn [INFO] Session establishment complete on server zoo1-1/172.16.218.10:2181, sessionid = 0x142d358dd410003, negotiated timeout = 20000

2013-12-08 17:55:15 nimbus [INFO] Starting Nimbus server...

2013-12-08 17:55:16 nimbus [INFO] Cleaning up exclamation-topology-1-1386525175

2013-12-08 17:59:00 nimbus [INFO] Uploading file from client to /app/storm/nimbus/inbox/stormjar-0d7bf84a-4bf6-4611-8532-a2a2aa9442ce.jar

2013-12-08 17:59:00 nimbus [INFO] Finished uploading file from client: /app/storm/nimbus/inbox/stormjar-0d7bf84a-4bf6-4611-8532-a2a2aa9442ce.jar

2013-12-08 17:59:01 nimbus [INFO] Received topology submission for exclamation-topology with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" nil, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "exclamation-topology", "storm.id" "exclamation-topology-1-1386525540", "topology.workers" 3, "topology.debug" true}

2013-12-08 17:59:01 nimbus [INFO] Activating exclamation-topology: exclamation-topology-1-1386525540

2013-12-08 17:59:01 nimbus [WARN] Topology submission exception. (topology name='exclamation-topology') #<NullPointerException java.lang.NullPointerException>

2013-12-08 17:59:01 TNonblockingServer [ERROR] Unexpected exception while invoking!

java.lang.NullPointerException

at clojure.lang.Numbers.ops(Numbers.java:942)

at clojure.lang.Numbers.isPos(Numbers.java:94)

at clojure.core$take$fn__4112.invoke(core.clj:2500)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$concat$fn__3804.invoke(core.clj:662)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$concat$cat__3806$fn__3807.invoke(core.clj:671)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$map$fn__4091.invoke(core.clj:2437)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30)

2013-12-08 17:59:07 nimbus [ERROR] Error when processing event

java.lang.NullPointerException

at clojure.lang.Numbers.ops(Numbers.java:942)

at clojure.lang.Numbers.isPos(Numbers.java:94)

at clojure.core$take$fn__4112.invoke(core.clj:2500)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$concat$fn__3804.invoke(core.clj:662)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$concat$cat__3806$fn__3807.invoke(core.clj:671)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

at clojure.core$seq.invoke(core.clj:133)

at clojure.core$map$fn__4091.invoke(core.clj:2437)

at clojure.lang.LazySeq.sval(LazySeq.java:42)

at clojure.lang.LazySeq.seq(LazySeq.java:60)

at clojure.lang.RT.seq(RT.java:473)

The same happens if I try to submit the topology from a remote server that is not the nimbus server

I strongly suspect I have misunderstood somthing quite simple but I cant figure out quite what it is and I'm tearing my hair out trying to figure out what the problem is. Any pointers would really be appreciated

nimbus config looks like this:

cat /usr/local/storm/conf/storm.yaml

########### These all have default values as shown

########### Additional configuration goes into storm.yaml

java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"

### storm.* configs are general configurations

# the local dir is where jars are kept

storm.local.dir: "/app/storm"

storm.zookeeper.servers:

- "zoo1-1"

storm.zookeeper.port: 2181

storm.zookeeper.root: "/storm"

storm.zookeeper.session.timeout: 20000

storm.zookeeper.connection.timeout: 15000

storm.zookeeper.retry.times: 5

storm.zookeeper.retry.interval: 1000

storm.zookeeper.retry.intervalceiling.millis: 30000

storm.cluster.mode: "distributed" # can be distributed or local

storm.local.mode.zmq: false

storm.thrift.transport: "backtype.storm.security.auth.SimpleTransportPlugin"

storm.messaging.transport: "backtype.storm.messaging.zmq"

### nimbus.* configs are for the master

nimbus.host: "nimbus1-1"

nimbus.thrift.port: 6627

nimbus.childopts: "-Xmx1024m -Djava.net.preferIPv4Stack=true"

nimbus.task.timeout.secs: 30

nimbus.supervisor.timeout.secs: 60

nimbus.monitor.freq.secs: 10

nimbus.cleanup.inbox.freq.secs: 600

nimbus.inbox.jar.expiration.secs: 3600

nimbus.task.launch.secs: 120

nimbus.reassign: true

nimbus.file.copy.expiration.secs: 600

nimbus.topology.validator: "backtype.storm.nimbus.DefaultTopologyValidator"

### ui.* configs are for the master

ui.port: 8080

ui.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"

logviewer.port: 8000

logviewer.childopts: "-Xmx128m"

logviewer.appender.name: "A1"

drpc.port: 3772

drpc.worker.threads: 64

drpc.queue.size: 128

drpc.invocations.port: 3773

drpc.request.timeout.secs: 600

drpc.childopts: "-Xmx768m"

transactional.zookeeper.root: "/transactional"

transactional.zookeeper.servers: null

transactional.zookeeper.port: null

### supervisor.* configs are for node supervisors

# Define the amount of workers that can be run on this machine. Each worker is assigned a port to use for communication

supervisor.slots.ports:

- 6700

- 6701

- 6702

- 6703

supervisor.childopts: "-Djava.net.preferIPv4Stack=true"

#how long supervisor will wait to ensure that a worker process is started

supervisor.worker.start.timeout.secs: 120

#how long between heartbeats until supervisor considers that worker dead and tries to restart it

supervisor.worker.timeout.secs: 30

#how frequently the supervisor checks on the status of the processes it's monitoring and restarts if necessary

supervisor.monitor.frequency.secs: 3

#how frequently the supervisor heartbeats to the cluster state (for nimbus)

supervisor.heartbeat.frequency.secs: 5

supervisor.enable: true

### worker.* configs are for task workers

worker.childopts: "-Xmx768m -Djava.net.preferIPv4Stack=true"

worker.heartbeat.frequency.secs: 1

task.heartbeat.frequency.secs: 3

task.refresh.poll.secs: 10

zmq.threads: 1

zmq.linger.millis: 5000

zmq.hwm: 0

storm.messaging.netty.server_worker_threads: 1

storm.messaging.netty.client_worker_threads: 1

storm.messaging.netty.buffer_size: 5242880 #5MB buffer

storm.messaging.netty.max_retries: 30

storm.messaging.netty.max_wait_ms: 1000

storm.messaging.netty.min_wait_ms: 100

### topology.* configs are for specific executing storms

topology.enable.message.timeouts: true

topology.debug: false

topology.optimize: true

topology.workers: 1

topology.acker.executors: null

topology.tasks: null

# maximum amount of time a message has to complete before it's considered failed

topology.message.timeout.secs: 30

topology.skip.missing.kryo.registrations: false

topology.max.task.parallelism: null

topology.max.spout.pending: null

topology.state.synchronization.timeout.secs: 60

topology.stats.sample.rate: 0.05

topology.builtin.metrics.bucket.size.secs: 60

topology.fall.back.on.java.serialization: true

topology.worker.childopts: null

topology.executor.receive.buffer.size: 1024 #batched

topology.executor.send.buffer.size: 1024 #individual messages

topology.receiver.buffer.size: 8 # setting it too high causes a lot of problems (heartbeat thread gets starved, throughput plummets)

topology.transfer.buffer.size: 1024 # batched

topology.tick.tuple.freq.secs: null

topology.worker.shared.thread.pool.size: 4

topology.disruptor.wait.strategy: "com.lmax.disruptor.BlockingWaitStrategy"

topology.spout.wait.strategy: "backtype.storm.spout.SleepSpoutWaitStrategy"

topology.sleep.spout.wait.strategy.time.ms: 1

topology.error.throttle.interval.secs: 10

topology.max.error.report.per.interval: 5

topology.kryo.factory: "backtype.storm.serialization.DefaultKryoFactory"

topology.tuple.serializer: "backtype.storm.serialization.types.ListDelegateSerializer"

topology.trident.batch.emit.interval.millis: 500

dev.zookeeper.path: "/tmp/dev-storm-zookeeper"

Reply all

Reply to author

Forward

0 new messages