Why the DRPC client failed to call DRPC server function

[Michael chen]

Hi all,

Encounter DRPCExecutionException when i run BasicDRPCClient .

Why?

client log is as following:

Start
Exception in thread "main" DRPCExecutionException(msg:Request failed)
at backtype.storm.generated.DistributedRPC
$execute_result.read(DistributedRPC.java:1113)
at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:
78)
at backtype.storm.generated.DistributedRPC
$Client.recv_execute(DistributedRPC.java:87)
at backtype.storm.generated.DistributedRPC
$Client.execute(DistributedRPC.java:73)
at backtype.storm.utils.DRPCClient.execute(DRPCClient.java:45)
at storm.starter.BasicDRPCClient.main(BasicDRPCClient.java:16)

worker log is as following:

2011-12-02 11:03:36 task [INFO] Failing message
backtype.storm.drpc.DRPCSpout$DRPCMessageId@48a01827: source: spout:8,
stream: default, id: {-7080820766650075829=-7080820766650075829},
[hello, {"port":3772,"id":"3","host":"10.0.0.24"}]

My client code is as following:

public class BasicDRPCClient {

public static void main(String[] args) throws TException,
DRPCExecutionException {
System.out.println("Start");
DRPCClient client = new DRPCClient("10.0.0.24", 3772);

String[] strArray = new String[] { "hello", "goodbye" };
for (String word : strArray) {
String ret = client.execute("exclamation", word);
System.out.println("Result for \"" + word + "\": "
+ ret);
}

// String[] urlsToTry = new String[] { "foo.com/blog/1",
"engineering.twitter.com/blog/5", "notaurl.com"};
// for(String url: urlsToTry) {
// System.out.println("Reach of " + url + ": " +
client.execute("reach", url));
// }

System.out.println("End");

}

}

[Michael chen]

storm.yaml as following:

storm.zookeeper.servers:
- "10.0.0.24"

storm.local.dir: "/home/clx/storm_data"

nimbus.host: "10.0.0.24"

nimbus.thrift.port: 6627

supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703

drpc.servers:
- "10.0.0.24"

[nathanmarz]

Hi Michael,

Based on that worker.log it looks like the topology is failing to
process the message. A few things:

1) Can you turn on TOPOLOGY_DEBUG and show the worker.log files in
that case?
2) Are you running BasicDRPCTopology from storm-starter?
3) Are you able to run non-DRPC topologies successfully (like
ExclamationTopology)?

-Nathan

[Michael chen]

Hi nathanmarz,

Thank you for your reply.

Also encountered the same error when i use storm-0.6.0 .

1) Can you turn on TOPOLOGY_DEBUG and show the worker.log files
in that case?

A: TOPOLOGY_DEBUG is turn on. But I am at home now, the
worker.log files in company's server. I will show it tomorrow.

2) Are you running BasicDRPCTopology from storm-starter?

A: Yes.I am running BasicDRPCTopology form storm-starter.

3) Are you able to run non-DRPC topologies successfully (like
ExclamationTopology)?

A: Yes. I can run non-DRPC topologies sueccessfull (like
ExclamationTopology and WordCounterTopology).

Look forward to your reply. Thank you.

[Nathan Marz]

storm-starter configures the topology to run on 3 workers, so it will be useful to see the logs of all the workers. I'm guessing that the worker nodes are failing to send the results back to the DRPC server - the TOPOLOGY_DEBUG output will be illuminating.

Can you also send the the log of the DRPC server?

-Nathan

--
Twitter: @nathanmarz
http://nathanmarz.com

[Michael chen]

Hi Nathan,

Thanks for so quick to reply.

I will show the log of the DRPC server and the log of the worker
tomorrow.

[Michael chen]

Hi Nathan,

drpc.log:

2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:host.name=59.37.71.88
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:00:19 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:00:19 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.88
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:00:19 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:00:20 drpc [INFO] Starting Distributed RPC server...
2011-12-05 09:05:16 TNonblockingServer [WARN] Got an IOException in
internalRead!
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcher.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:237)
at sun.nio.ch.IOUtil.read(IOUtil.java:210)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:236)
at
org.apache.thrift7.transport.TNonblockingSocket.read(TNonblockingSocket.java:
141)
at org.apache.thrift7.server.TNonblockingServer
$FrameBuffer.internalRead(TNonblockingServer.java:669)
at org.apache.thrift7.server.TNonblockingServer
$FrameBuffer.read(TNonblockingServer.java:458)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.handleRead(TNonblockingServer.java:359)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.select(TNonblockingServer.java:304)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.run(TNonblockingServer.java:243)
2011-12-05 09:10:25 TNonblockingServer [WARN] Got an IOException in
internalRead!
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcher.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:237)
at sun.nio.ch.IOUtil.read(IOUtil.java:210)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:236)
at
org.apache.thrift7.transport.TNonblockingSocket.read(TNonblockingSocket.java:
141)
at org.apache.thrift7.server.TNonblockingServer
$FrameBuffer.internalRead(TNonblockingServer.java:669)
at org.apache.thrift7.server.TNonblockingServer
$FrameBuffer.read(TNonblockingServer.java:458)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.handleRead(TNonblockingServer.java:359)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.select(TNonblockingServer.java:304)
at org.apache.thrift7.server.TNonblockingServer
$SelectThread.run(TNonblockingServer.java:243)

worker-6701.log:

2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:host.name=59.37.71.88
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:02:15 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:02:15 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.88
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:02:15 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:02:15 worker [INFO] Launching worker for
basicDRPCTop-1-1323046931 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6701
with id 713968d1-2844-40cc-a974-d2296c36085b
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@3b8e80a6
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200008, negotiated timeout = 10000
2011-12-05 09:02:15 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:02:15 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:02:15 ZooKeeper [INFO] Session: 0x1340bb6e8200008 closed
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@65d9e279
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200009, negotiated timeout = 20000
2011-12-05 09:02:16 task [INFO] Loading task spout:8
2011-12-05 09:02:16 task [INFO] Opening spout spout:8
2011-12-05 09:02:16 task [INFO] Opened spout spout:8
2011-12-05 09:02:16 task [INFO] Finished loading task spout:8
2011-12-05 09:02:16 task [INFO] Loading task bolt0:5
2011-12-05 09:02:16 task [INFO] Preparing bolt bolt0:5
2011-12-05 09:02:16 task [INFO] Prepared bolt bolt0:5
2011-12-05 09:02:16 task [INFO] Finished loading task bolt0:5
2011-12-05 09:02:16 task [INFO] Loading task bolt1:2
2011-12-05 09:02:16 task [INFO] Preparing bolt bolt1:2
2011-12-05 09:02:16 task [INFO] Prepared bolt bolt1:2
2011-12-05 09:02:16 task [INFO] Finished loading task bolt1:2
2011-12-05 09:02:16 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6701
2011-12-05 09:02:16 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-1-1323046931",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug"
false, "nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs"
60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:02:16 worker [INFO] Worker 713968d1-2844-40cc-a974-
d2296c36085b for storm basicDRPCTop-1-1323046931 on 0afa8f03-15d1-4341-
b0ca-2e1bec983444:6701 has finished loading
2011-12-05 09:05:16 task [INFO] Failing message
backtype.storm.drpc.DRPCSpout$DRPCMessageId@1efa9557: source: spout:8,
stream: default, id: {-7873349134227371997=-7873349134227371997},
[hello, {"port":3772,"id":"1","host":"10.0.0.24"}]
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:host.name=59.37.71.88
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:07:53 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:07:53 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:host.name=61.140.3.66
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:07:53 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:07:54 worker [INFO] Launching worker for
basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6701
with id 0aeb9672-8ec2-4b4b-bae9-de66334b80b3
2011-12-05 09:07:54 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@2017b2b2
2011-12-05 09:07:54 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:54 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:54 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000a, negotiated timeout = 10000
2011-12-05 09:07:54 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:07:54 ZooKeeper [INFO] Session: 0x1340bb6e820000a closed
2011-12-05 09:07:54 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:07:54 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@24a09e41
2011-12-05 09:07:54 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:54 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:54 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000b, negotiated timeout = 20000
2011-12-05 09:07:54 task [INFO] Loading task spout:8
2011-12-05 09:07:55 task [INFO] Opening spout spout:8
2011-12-05 09:07:55 task [INFO] Opened spout spout:8
2011-12-05 09:07:55 task [INFO] Finished loading task spout:8
2011-12-05 09:07:55 task [INFO] Loading task bolt0:5
2011-12-05 09:07:55 task [INFO] Preparing bolt bolt0:5
2011-12-05 09:07:55 task [INFO] Prepared bolt bolt0:5
2011-12-05 09:07:55 task [INFO] Finished loading task bolt0:5
2011-12-05 09:07:55 task [INFO] Loading task bolt1:2
2011-12-05 09:07:55 task [INFO] Preparing bolt bolt1:2
2011-12-05 09:07:55 task [INFO] Prepared bolt bolt1:2
2011-12-05 09:07:55 task [INFO] Finished loading task bolt1:2
2011-12-05 09:07:55 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6701
2011-12-05 09:07:55 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-2-1323047271",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" true,
"nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs" 60,
"topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:07:55 worker [INFO] Worker 0aeb9672-8ec2-4b4b-bae9-
de66334b80b3 for storm basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-
b0ca-2e1bec983444:6701 has finished loading
2011-12-05 09:09:51 task [INFO] Emitting: spout source: spout:8,
stream: default, id: {-7016170385137805544=-7016170385137805544},
[hello, {"port":3772,"id":"2","host":"10.0.0.24"}]
2011-12-05 09:09:51 task [INFO] Emitting: spout source: spout:8,
stream: __ack_init, id: {}, [-7016170385137805544 8]
2011-12-05 09:10:25 task [INFO] Failing message
backtype.storm.drpc.DRPCSpout$DRPCMessageId@2b5d70ae: source: spout:8,
stream: default, id: {-7016170385137805544=-7016170385137805544},
[hello, {"port":3772,"id":"2","host":"10.0.0.24"}]

work-6700.log:

2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:host.name=59.37.71.86
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.86
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:02:15 worker [INFO] Launching worker for
basicDRPCTop-1-1323046931 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6700
with id c4abfaab-256c-4148-aa19-0a79d23f016d
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@8a030d6
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200005, negotiated timeout = 10000
2011-12-05 09:02:15 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:02:15 ZooKeeper [INFO] Session: 0x1340bb6e8200005 closed
2011-12-05 09:02:15 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@43a3aa2c
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200007, negotiated timeout = 20000
2011-12-05 09:02:15 task [INFO] Loading task bolt0:7
2011-12-05 09:02:15 task [INFO] Preparing bolt bolt0:7
2011-12-05 09:02:15 task [INFO] Prepared bolt bolt0:7
2011-12-05 09:02:15 task [INFO] Finished loading task bolt0:7
2011-12-05 09:02:15 task [INFO] Loading task prepare-request:4
2011-12-05 09:02:15 task [INFO] Preparing bolt prepare-request:4
2011-12-05 09:02:15 task [INFO] Prepared bolt prepare-request:4
2011-12-05 09:02:15 task [INFO] Finished loading task prepare-request:
4
2011-12-05 09:02:15 task [INFO] Loading task __acker:1
2011-12-05 09:02:15 task [INFO] Preparing bolt __acker:1
2011-12-05 09:02:15 task [INFO] Prepared bolt __acker:1
2011-12-05 09:02:15 task [INFO] Finished loading task __acker:1
2011-12-05 09:02:15 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6700
2011-12-05 09:02:16 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-1-1323046931",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug"
false, "nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs"
60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:02:16 worker [INFO] Worker c4abfaab-256c-4148-
aa19-0a79d23f016d for storm basicDRPCTop-1-1323046931 on
0afa8f03-15d1-4341-b0ca-2e1bec983444:6700 has finished loading
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:host.name=59.37.71.86
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.87
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:07:59 worker [INFO] Launching worker for
basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6700
with id b64555df-ab96-47e5-84d2-ae203ac106ba
2011-12-05 09:07:59 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@35a3e41f
2011-12-05 09:07:59 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:59 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:59 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000d, negotiated timeout = 10000
2011-12-05 09:07:59 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:07:59 ZooKeeper [INFO] Session: 0x1340bb6e820000d closed
2011-12-05 09:07:59 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:07:59 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@7f1d3226
2011-12-05 09:07:59 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:59 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:59 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000f, negotiated timeout = 20000
2011-12-05 09:07:59 task [INFO] Loading task bolt0:7
2011-12-05 09:08:00 task [INFO] Preparing bolt bolt0:7
2011-12-05 09:08:00 task [INFO] Prepared bolt bolt0:7
2011-12-05 09:08:00 task [INFO] Finished loading task bolt0:7
2011-12-05 09:08:00 task [INFO] Loading task prepare-request:4
2011-12-05 09:08:00 task [INFO] Preparing bolt prepare-request:4
2011-12-05 09:08:00 task [INFO] Prepared bolt prepare-request:4
2011-12-05 09:08:00 task [INFO] Finished loading task prepare-request:
4
2011-12-05 09:08:00 task [INFO] Loading task __acker:1
2011-12-05 09:08:00 task [INFO] Preparing bolt __acker:1
2011-12-05 09:08:00 task [INFO] Prepared bolt __acker:1
2011-12-05 09:08:00 task [INFO] Finished loading task __acker:1
2011-12-05 09:08:00 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6700
2011-12-05 09:08:00 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-2-1323047271",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" true,
"nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs" 60,
"topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:08:00 worker [INFO] Worker b64555df-ab96-47e5-84d2-
ae203ac106ba for storm basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-
b0ca-2e1bec983444:6700 has finished loading

worker-6702.log:

2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:host.name=59.37.71.86
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:02:14 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:02:14 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.87
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-1-1323046931/stormjar.jar
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:02:14 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:02:15 worker [INFO] Launching worker for
basicDRPCTop-1-1323046931 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
with id 48b89e45-412a-431d-9fc8-3056dfa45dd7
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@44323274
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200004, negotiated timeout = 10000
2011-12-05 09:02:15 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:02:15 ZooKeeper [INFO] Session: 0x1340bb6e8200004 closed
2011-12-05 09:02:15 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:02:15 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@5140709
2011-12-05 09:02:15 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:02:15 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:02:15 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e8200006, negotiated timeout = 20000
2011-12-05 09:02:15 task [INFO] Loading task bolt0:6
2011-12-05 09:02:15 task [INFO] Preparing bolt bolt0:6
2011-12-05 09:02:15 task [INFO] Prepared bolt bolt0:6
2011-12-05 09:02:15 task [INFO] Finished loading task bolt0:6
2011-12-05 09:02:15 task [INFO] Loading task bolt2:3
2011-12-05 09:02:15 task [INFO] Preparing bolt bolt2:3
2011-12-05 09:02:15 task [INFO] Prepared bolt bolt2:3
2011-12-05 09:02:15 task [INFO] Finished loading task bolt2:3
2011-12-05 09:02:15 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
2011-12-05 09:02:15 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-1-1323046931",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug"
false, "nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs"
60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:02:15 worker [INFO] Worker
48b89e45-412a-431d-9fc8-3056dfa45dd7 for storm
basicDRPCTop-1-1323046931 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
has finished loading
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:host.name=59.37.71.88
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 09:07:58 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 09:07:58 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.86
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.class.path=/home/clx/storm-0.6.0/storm-0.6.0.jar:/
home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/jline-0.9.94.jar:/home/
clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/clx/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/junit-3.8.1.jar:/
home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/clx/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/clojure-
contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
clx/storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/clx/storm-0.6.0/
lib/commons-io-1.4.jar:/home/clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/
home/clx/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/clx/storm-0.6.0/
lib/commons-codec-1.3.jar:/home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/
home/clx/storm-0.6.0/lib/jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/
commons-fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-
log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/
basicDRPCTop-2-1323047271/stormjar.jar
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 09:07:58 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 09:07:59 worker [INFO] Launching worker for
basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
with id 1a10d13b-88ca-4906-89b5-1f5b23dcf34a
2011-12-05 09:07:59 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@2017b2b2
2011-12-05 09:07:59 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:59 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:59 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000c, negotiated timeout = 10000
2011-12-05 09:07:59 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 09:07:59 ZooKeeper [INFO] Session: 0x1340bb6e820000c closed
2011-12-05 09:07:59 ClientCnxn [INFO] EventThread shut down
2011-12-05 09:07:59 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@4aee260b
2011-12-05 09:07:59 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 09:07:59 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 09:07:59 ClientCnxn [INFO] Session establishment complete
on server localhost.localdomain/10.0.0.24:2181, sessionid =
0x1340bb6e820000e, negotiated timeout = 20000
2011-12-05 09:07:59 task [INFO] Loading task bolt0:6
2011-12-05 09:08:00 task [INFO] Preparing bolt bolt0:6
2011-12-05 09:08:00 task [INFO] Prepared bolt bolt0:6
2011-12-05 09:08:00 task [INFO] Finished loading task bolt0:6
2011-12-05 09:08:00 task [INFO] Loading task bolt2:3
2011-12-05 09:08:00 task [INFO] Preparing bolt bolt2:3
2011-12-05 09:08:00 task [INFO] Prepared bolt bolt2:3
2011-12-05 09:08:00 task [INFO] Finished loading task bolt2:3
2011-12-05 09:08:00 worker [INFO] Launching virtual port for
0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
2011-12-05 09:08:00 worker [INFO] Worker has topology config
{"storm.id" "basicDRPCTop-2-1323047271",
"topology.fall.back.on.java.serialization" true, "zmq.linger.millis"
5000, "topology.skip.missing.kryo.registrations" false,
"storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true,
"drpc.servers" ["10.0.0.24"], "nimbus.monitor.freq.secs" 10,
"java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib",
"storm.local.dir" "/home/clx/storm_data",
"supervisor.worker.start.timeout.secs" 240, "nimbus.host" "10.0.0.24",
"storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm",
"supervisor.enable" true, "storm.zookeeper.servers" ["10.0.0.24"],
"worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs"
5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3,
"task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil,
"supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" true,
"nimbus.task.launch.secs" 240, "nimbus.supervisor.timeout.secs" 60,
"topology.kryo.register" nil, "topology.message.timeout.secs" 30,
"task.refresh.poll.secs" 10, "topology.workers" 3,
"supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627,
"topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs"
1, "nimbus.task.timeout.secs" 30, "zmq.threads" 1,
"topology.state.synchronization.timeout.secs" 60,
"supervisor.worker.timeout.secs" 30,
"nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false,
"ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1,
"storm.cluster.mode" "distributed", "topology.optimize" true,
"topology.max.task.parallelism" nil}
2011-12-05 09:08:00 worker [INFO] Worker
1a10d13b-88ca-4906-89b5-1f5b23dcf34a for storm
basicDRPCTop-2-1323047271 on 0afa8f03-15d1-4341-b0ca-2e1bec983444:6702
has finished loading

On 12月4日, 上午9时33分, Nathan Marz <nathan.m...@gmail.com> wrote:

> Twitter: @nathanmarzhttp://nathanmarz.com- 隐藏被引用文字 -
>
> - 显示引用的文字 -

[nathanmarz]

It looks like the topology is receiving the DRPC request, but request
is not making it from the spout into the rest of the topology. This
doesn't make sense given that you're able to run regular topologies
without issue. Everything else in your logs looks normal, and it looks
like all the tasks are launching just fine.

I'm really not sure what the issue is. Can you send me your
nimbus.log? Also, is there anything at all different from the topology
you're running versus the storm-starter version?

-Nathan

[Michael chen]

HI Nathan,

Thanks for your reply.

nimbus.log

2011-12-05 08:59:23 ZooKeeper [INFO] Client

environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT

2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:host.name=59.37.71.86
2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 08:59:23 ZooKeeper [INFO] Client

2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 08:59:23 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 08:59:23 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server

environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT

2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:host.name=59.37.71.86
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server

2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 08:59:23 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 08:59:23 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@3d80a8b7
2011-12-05 08:59:23 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 08:59:23 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 08:59:23 ClientCnxn [INFO] Session establishment complete

on server localhost.localdomain/10.0.0.24:2181, sessionid =

0x1340bb6e8200000, negotiated timeout = 10000
2011-12-05 08:59:23 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 08:59:23 ZooKeeper [INFO] Session: 0x1340bb6e8200000 closed
2011-12-05 08:59:23 ClientCnxn [INFO] EventThread shut down
2011-12-05 08:59:23 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@17a73d30
2011-12-05 08:59:23 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 08:59:23 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 08:59:23 ClientCnxn [INFO] Session establishment complete

on server localhost.localdomain/10.0.0.24:2181, sessionid =

0x1340bb6e8200001, negotiated timeout = 20000
2011-12-05 08:59:23 nimbus [INFO] Starting Nimbus server...
2011-12-05 09:02:11 nimbus [INFO] Uploading file from client to /home/
clx/storm_data/nimbus/inbox/stormjar-283d4163-
c5a7-4d60-99c4-985ced21b71f.jar
2011-12-05 09:02:11 nimbus [INFO] Finished uploading file from
client: /home/clx/storm_data/nimbus/inbox/stormjar-283d4163-
c5a7-4d60-99c4-985ced21b71f.jar
2011-12-05 09:02:11 nimbus [INFO] Received topology submission for
basicDRPCTop with conf {"topology.kryo.register" nil, "storm.id"
"basicDRPCTop-1-1323046931", "topology.workers" 3}
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:1
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:2
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:3
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:4
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:5
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:6
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:7
timed out
2011-12-05 09:02:12 nimbus [INFO] Task basicDRPCTop-1-1323046931:8
timed out
2011-12-05 09:02:12 nimbus [INFO] Reassigning
basicDRPCTop-1-1323046931 to 3 slots
2011-12-05 09:02:12 nimbus [INFO] Reassign ids: [1 2 3 4 5 6 7 8]
2011-12-05 09:02:12 nimbus [INFO] Available slots:
(["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700] ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6701] ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6702]
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6703])
2011-12-05 09:02:12 nimbus [INFO] Setting new assignment for storm id
basicDRPCTop-1-1323046931:
#:backtype.storm.daemon.common.Assignment{:master-code-dir "/home/clx/
storm_data/nimbus/stormdist/basicDRPCTop-1-1323046931", :node->host
{"0afa8f03-15d1-4341-b0ca-2e1bec983444" "59.37.71.86"}, :task->node
+port {8 ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6701], 7
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700], 6 ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6702], 5 ["0afa8f03-15d1-4341-b0ca-2e1bec983444"
6701], 4 ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700], 3
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6702], 2 ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6701], 1 ["0afa8f03-15d1-4341-b0ca-2e1bec983444"
6700]}, :task->start-time-secs {2 1323046932, 5 1323046932, 8
1323046932, 1 1323046932, 4 1323046932, 7 1323046932, 3 1323046932, 6
1323046932}}
2011-12-05 09:02:12 nimbus [INFO] Activating basicDRPCTop:
basicDRPCTop-1-1323046931
2011-12-05 09:06:10 nimbus [INFO] Deactivated basicDRPCTop and
scheduled to be killed
2011-12-05 09:06:10 nimbus [INFO] Entering kill loop for
{"basicDRPCTop-1-1323046931" 1323047200}
2011-12-05 09:06:10 nimbus [INFO] Waiting for 30 seconds to kill
topology basicDRPCTop-1-1323046931
2011-12-05 09:06:40 nimbus [INFO] Killing topology:
basicDRPCTop-1-1323046931
2011-12-05 09:06:40 nimbus [INFO] Killed {"basicDRPCTop-1-1323046931"
1323047200}
2011-12-05 09:07:03 nimbus [INFO] Cleaned up topology task heartbeats:
("basicDRPCTop-1-1323046931")
2011-12-05 09:07:50 nimbus [INFO] Uploading file from client to /home/
clx/storm_data/nimbus/inbox/stormjar-8b22f64d-e05b-4082-
ae3a-894ec3da1ac8.jar
2011-12-05 09:07:50 nimbus [INFO] Finished uploading file from
client: /home/clx/storm_data/nimbus/inbox/stormjar-8b22f64d-e05b-4082-
ae3a-894ec3da1ac8.jar
2011-12-05 09:07:51 nimbus [INFO] Received topology submission for
basicDRPCTop with conf {"topology.kryo.register" nil, "storm.id"
"basicDRPCTop-2-1323047271", "topology.workers" 3, "topology.debug"
true}
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:1
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:2
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:3
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:4
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:5
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:6
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:7
timed out
2011-12-05 09:07:51 nimbus [INFO] Task basicDRPCTop-2-1323047271:8
timed out
2011-12-05 09:07:51 nimbus [INFO] Reassigning
basicDRPCTop-2-1323047271 to 3 slots
2011-12-05 09:07:51 nimbus [INFO] Reassign ids: [1 2 3 4 5 6 7 8]
2011-12-05 09:07:51 nimbus [INFO] Available slots:
(["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700] ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6701] ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6702]
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6703])
2011-12-05 09:07:51 nimbus [INFO] Setting new assignment for storm id
basicDRPCTop-2-1323047271:
#:backtype.storm.daemon.common.Assignment{:master-code-dir "/home/clx/
storm_data/nimbus/stormdist/basicDRPCTop-2-1323047271", :node->host
{"0afa8f03-15d1-4341-b0ca-2e1bec983444" "59.37.71.86"}, :task->node
+port {8 ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6701], 7
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700], 6 ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6702], 5 ["0afa8f03-15d1-4341-b0ca-2e1bec983444"
6701], 4 ["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6700], 3
["0afa8f03-15d1-4341-b0ca-2e1bec983444" 6702], 2 ["0afa8f03-15d1-4341-
b0ca-2e1bec983444" 6701], 1 ["0afa8f03-15d1-4341-b0ca-2e1bec983444"
6700]}, :task->start-time-secs {2 1323047271, 5 1323047271, 8
1323047271, 1 1323047271, 4 1323047271, 7 1323047271, 3 1323047271, 6
1323047271}}
2011-12-05 09:07:51 nimbus [INFO] Activating basicDRPCTop:
basicDRPCTop-2-1323047271

supervisor.log

2011-12-05 08:59:47 ZooKeeper [INFO] Client

environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT

2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:host.name=61.140.3.66
2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:java.version=1.6.0_21
2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:java.home=/usr/
java/jdk1.6.0_21/jre
2011-12-05 08:59:47 ZooKeeper [INFO] Client

2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:java.io.tmpdir=/tmp
2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:java.compiler=<NA>
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:os.name=Linux
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:os.arch=amd64
2011-12-05 08:59:47 ZooKeeper [INFO] Client
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:user.name=root
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:user.home=/
root
2011-12-05 08:59:47 ZooKeeper [INFO] Client environment:user.dir=/home/
clx/storm-0.6.0/bin
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server

environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32
GMT

2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:host.name=61.140.3.66
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.version=1.6.0_21
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.vendor=Sun Microsystems Inc.
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.home=/usr/java/jdk1.6.0_21/jre
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server

2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.io.tmpdir=/tmp
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:java.compiler=<NA>
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:os.name=Linux
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:os.arch=amd64
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:os.version=2.6.18-238.19.1.el5
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:user.name=root
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:user.home=/root
2011-12-05 08:59:47 ZooKeeperServer [INFO] Server
environment:user.dir=/home/clx/storm-0.6.0/bin
2011-12-05 08:59:47 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/ sessionTimeout=10000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@7c6576d5
2011-12-05 08:59:47 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 08:59:47 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 08:59:47 ClientCnxn [INFO] Session establishment complete

on server localhost.localdomain/10.0.0.24:2181, sessionid =

0x1340bb6e8200002, negotiated timeout = 10000
2011-12-05 08:59:47 ZooKeeper [INFO] Session: 0x1340bb6e8200002 closed
2011-12-05 08:59:47 zookeeper [INFO] Zookeeper state
update: :connected:none
2011-12-05 08:59:47 ClientCnxn [INFO] EventThread shut down
2011-12-05 08:59:47 ZooKeeper [INFO] Initiating client connection,
connectString=10.0.0.24:2181/storm sessionTimeout=20000
watcher=backtype.storm.zookeeper$mk_client$reify__1340@66ff45de
2011-12-05 08:59:47 ClientCnxn [INFO] Opening socket connection to
server /10.0.0.24:2181
2011-12-05 08:59:47 ClientCnxn [INFO] Socket connection established to
localhost.localdomain/10.0.0.24:2181, initiating session
2011-12-05 08:59:47 ClientCnxn [INFO] Session establishment complete

on server localhost.localdomain/10.0.0.24:2181, sessionid =

0x1340bb6e8200003, negotiated timeout = 20000
2011-12-05 08:59:48 supervisor [INFO] Starting supervisor with id
0afa8f03-15d1-4341-b0ca-2e1bec983444
2011-12-05 09:02:12 supervisor [INFO] Downloading code for storm id
basicDRPCTop-1-1323046931 from /home/clx/storm_data/nimbus/stormdist/
basicDRPCTop-1-1323046931
2011-12-05 09:02:12 supervisor [INFO] Finished downloading code for
storm id basicDRPCTop-1-1323046931 from /home/clx/storm_data/nimbus/
stormdist/basicDRPCTop-1-1323046931
2011-12-05 09:02:12 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-1-1323046931", :task-ids (6 3)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6702 with id
48b89e45-412a-431d-9fc8-3056dfa45dd7
2011-12-05 09:02:12 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6702.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-1-1323046931/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-1-1323046931 0afa8f03-15d1-4341-b0ca-2e1bec983444 6702
48b89e45-412a-431d-9fc8-3056dfa45dd7
2011-12-05 09:02:12 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-1-1323046931", :task-ids (7 4 1)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6700 with id
c4abfaab-256c-4148-aa19-0a79d23f016d
2011-12-05 09:02:12 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6700.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-1-1323046931/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-1-1323046931 0afa8f03-15d1-4341-b0ca-2e1bec983444 6700
c4abfaab-256c-4148-aa19-0a79d23f016d
2011-12-05 09:02:12 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-1-1323046931", :task-ids (8 5 2)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6701 with id
713968d1-2844-40cc-a974-d2296c36085b
2011-12-05 09:02:12 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6701.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-1-1323046931/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-1-1323046931 0afa8f03-15d1-4341-b0ca-2e1bec983444 6701
713968d1-2844-40cc-a974-d2296c36085b
2011-12-05 09:02:12 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:13 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:13 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:14 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:14 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:15 supervisor [INFO]
48b89e45-412a-431d-9fc8-3056dfa45dd7 still hasn't started
2011-12-05 09:02:15 supervisor [INFO] 713968d1-2844-40cc-a974-
d2296c36085b still hasn't started
2011-12-05 09:06:40 supervisor [INFO] Removing code for storm id
basicDRPCTop-1-1323046931
2011-12-05 09:06:40 supervisor [INFO] Shutting down and clearing state
for id c4abfaab-256c-4148-aa19-0a79d23f016d. State: :disallowed,
Heartbeat: #:backtype.storm.daemon.common.WorkerHeartbeat{:time-secs
1323047200, :storm-id "basicDRPCTop-1-1323046931", :task-ids (7 4
1), :port 6700}
2011-12-05 09:06:40 supervisor [INFO] Shutting down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:c4abfaab-256c-4148-aa19-0a79d23f016d
2011-12-05 09:06:40 supervisor [INFO] Shut down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:c4abfaab-256c-4148-aa19-0a79d23f016d
2011-12-05 09:06:40 supervisor [INFO] Shutting down and clearing state
for id 713968d1-2844-40cc-a974-d2296c36085b. State: :disallowed,
Heartbeat: #:backtype.storm.daemon.common.WorkerHeartbeat{:time-secs
1323047200, :storm-id "basicDRPCTop-1-1323046931", :task-ids (8 5
2), :port 6701}
2011-12-05 09:06:40 supervisor [INFO] Shutting down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:713968d1-2844-40cc-a974-d2296c36085b
2011-12-05 09:06:40 supervisor [INFO] Shut down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:713968d1-2844-40cc-a974-d2296c36085b
2011-12-05 09:06:40 supervisor [INFO] Shutting down and clearing state
for id 48b89e45-412a-431d-9fc8-3056dfa45dd7. State: :disallowed,
Heartbeat: #:backtype.storm.daemon.common.WorkerHeartbeat{:time-secs
1323047200, :storm-id "basicDRPCTop-1-1323046931", :task-ids (6
3), :port 6702}
2011-12-05 09:06:40 supervisor [INFO] Shutting down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:48b89e45-412a-431d-9fc8-3056dfa45dd7
2011-12-05 09:06:40 supervisor [INFO] Shut down 0afa8f03-15d1-4341-
b0ca-2e1bec983444:48b89e45-412a-431d-9fc8-3056dfa45dd7
2011-12-05 09:07:51 supervisor [INFO] Downloading code for storm id
basicDRPCTop-2-1323047271 from /home/clx/storm_data/nimbus/stormdist/
basicDRPCTop-2-1323047271
2011-12-05 09:07:51 supervisor [INFO] Finished downloading code for
storm id basicDRPCTop-2-1323047271 from /home/clx/storm_data/nimbus/
stormdist/basicDRPCTop-2-1323047271
2011-12-05 09:07:51 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-2-1323047271", :task-ids (6 3)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6702 with id
1a10d13b-88ca-4906-89b5-1f5b23dcf34a
2011-12-05 09:07:51 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6702.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-2-1323047271/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-2-1323047271 0afa8f03-15d1-4341-b0ca-2e1bec983444 6702
1a10d13b-88ca-4906-89b5-1f5b23dcf34a
2011-12-05 09:07:51 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-2-1323047271", :task-ids (7 4 1)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6700 with id b64555df-
ab96-47e5-84d2-ae203ac106ba
2011-12-05 09:07:51 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6700.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-2-1323047271/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-2-1323047271 0afa8f03-15d1-4341-b0ca-2e1bec983444 6700
b64555df-ab96-47e5-84d2-ae203ac106ba
2011-12-05 09:07:51 supervisor [INFO] Launching worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"basicDRPCTop-2-1323047271", :task-ids (8 5 2)} for this supervisor
0afa8f03-15d1-4341-b0ca-2e1bec983444 on port 6701 with id
0aeb9672-8ec2-4b4b-bae9-de66334b80b3
2011-12-05 09:07:51 supervisor [INFO] Launching worker with command:
java -server -Xmx768m -Djava.library.path=/usr/local/lib:/opt/local/
lib:/usr/lib -Dlogfile.name=worker-6701.log -
Dlog4j.configuration=storm.log.properties -cp /home/clx/storm-0.6.0/

storm-0.6.0.jar:/home/clx/storm-0.6.0/lib/log4j-1.2.16.jar:/home/clx/
storm-0.6.0/lib/tools.macro-0.1.0.jar:/home/clx/storm-0.6.0/lib/

jline-0.9.94.jar:/home/clx/storm-0.6.0/lib/commons-lang-2.5.jar:/home/
clx/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/clx/storm-0.6.0/lib/

junit-3.8.1.jar:/home/clx/storm-0.6.0/lib/compojure-0.6.4.jar:/home/
clx/storm-0.6.0/lib/zookeeper-3.3.2.jar:/home/clx/storm-0.6.0/lib/
clojure-contrib-1.2.0.jar:/home/clx/storm-0.6.0/lib/
httpcore-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/clx/storm-0.6.0/lib/commons-io-1.4.jar:/home/
clx/storm-0.6.0/lib/ring-core-0.3.10.jar:/home/clx/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/clx/storm-0.6.0/lib/commons-codec-1.3.jar:/

home/clx/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/clx/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/clx/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/clx/storm-0.6.0/lib/slf4j-

log4j12-1.5.8.jar:/home/clx/storm-0.6.0/lib/minlog-1.2.jar:/home/clx/
storm-0.6.0/lib/servlet-api-2.5.jar:/home/clx/storm-0.6.0/lib/json-
simple-1.1.jar:/home/clx/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/clx/storm-0.6.0/lib/slf4j-api-1.5.8.jar:/home/
clx/storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/clx/storm-0.6.0/lib/
joda-time-1.6.jar:/home/clx/storm-0.6.0/lib/libthrift7-0.7.0.jar:/home/
clx/storm-0.6.0/lib/commons-exec-1.1.jar:/home/clx/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/clx/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/clx/storm-0.6.0/lib/reflectasm-1.01.jar:/home/clx/storm-0.6.0/lib/
kryo-1.04.jar:/home/clx/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/clx/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/clx/storm-0.6.0/lib/
hiccup-0.3.6.jar:/home/clx/storm-0.6.0/lib/asm-3.2.jar:/home/clx/
storm-0.6.0/lib/clout-0.4.1.jar:/home/clx/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/clx/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/clx/storm-0.6.0/log4j:/home/clx/storm-0.6.0/
conf:/home/clx/storm_data/supervisor/stormdist/

basicDRPCTop-2-1323047271/stormjar.jar backtype.storm.daemon.worker
basicDRPCTop-2-1323047271 0afa8f03-15d1-4341-b0ca-2e1bec983444 6701
0aeb9672-8ec2-4b4b-bae9-de66334b80b3
2011-12-05 09:07:51 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:51 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:52 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:52 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:53 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:53 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:54 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:54 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:55 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:55 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:56 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:56 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:57 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:57 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:58 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:58 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started
2011-12-05 09:07:59 supervisor [INFO]
1a10d13b-88ca-4906-89b5-1f5b23dcf34a still hasn't started

> ...
>
> 阅读更多 »- 隐藏被引用文字 -
>
> - 显示引用的文字 -

[Michael chen]

Hi Nathan,

storm-starter version is the latest version.

BasicDRPCTopology is as following:

package storm.starter;

import backtype.storm.Config;
import backtype.storm.LocalCluster;
import backtype.storm.LocalDRPC;
import backtype.storm.StormSubmitter;
import backtype.storm.drpc.LinearDRPCTopologyBuilder;
import backtype.storm.task.TopologyContext;
import backtype.storm.topology.BasicOutputCollector;
import backtype.storm.topology.IBasicBolt;
import backtype.storm.topology.OutputFieldsDeclarer;
import backtype.storm.tuple.Fields;
import backtype.storm.tuple.Tuple;
import backtype.storm.tuple.Values;
import java.util.Map;

/**
* This topology is a basic example of doing distributed RPC on top of
Storm. It implements a function
* that appends a "!" to any string you send the DRPC function.
*
* See https://github.com/nathanmarz/storm/wiki/Distributed-RPC for
more information on
* doing distributed RPC on top of Storm.
*/
public class BasicDRPCTopology {
public static class ExclaimBolt implements IBasicBolt {
public void prepare(Map conf, TopologyContext context) {
}

@Override
public void execute(Tuple tuple, BasicOutputCollector
collector) {
String input = tuple.getString(1);
collector.emit(new Values(tuple.getValue(0), input +
"!"));
}

@Override
public void cleanup() {
}

@Override
public void declareOutputFields(OutputFieldsDeclarer declarer)
{
declarer.declare(new Fields("id", "result"));
}

}

public static void main(String[] args) throws Exception {
LinearDRPCTopologyBuilder builder = new
LinearDRPCTopologyBuilder("exclamation");
builder.addBolt(new ExclaimBolt(), 3);

Config conf = new Config();
conf.setDebug(true);

if(args==null || args.length==0) {
LocalDRPC drpc = new LocalDRPC();
LocalCluster cluster = new LocalCluster();

cluster.submitTopology("drpc-demo", conf,
builder.createLocalTopology(drpc));

for(String word: new String[] {"hello", "goodbye"}) {

System.out.println("Result for \"" + word + "\": "

+ drpc.execute("exclamation", word));
}

cluster.shutdown();
drpc.shutdown();
} else {
conf.setNumWorkers(3);
StormSubmitter.submitTopology(args[0], conf,
builder.createRemoteTopology());
}
}
}

[nathanmarz]

Everything looks completely normal. Does it work in local mode? What
about if you try running it in remote mode with only one worker?

-Nathan

[Michael Chen]

Hi Nathan,

Thanks for your reply.

It is work in local mode.

Now, The DRPC client calls the DRPC server function successfully. I
guess this is the real reason. I Modified /etc/hosts for setting DNS,
set new hostname as follow:

10.0.0.24 localhost.localdomain localhost10.0.0.24 xop-dev-
a.localdomain xop-dev-a

Thank you for your help!

[Nathan Marz]

It sounds like it can't communicate across machines. It's possible that the output you saw with WordCountTopology was just the computation it was able to do on each machine individually. Can you try this:

1. Change the parallelism of every component to "1" in WordCountTopology (the spout and both bolts)

2. Launch WordCountTopology with 3 workers.

3. Verify that the workers are running on both supervisor nodes

4. See if you get [word, count] tuples emitted anywhere

This will test whether or not Storm is able to communicate between nodes which seems to be the problem you're facing.

-Nathan

On Wed, Dec 7, 2011 at 3:44 AM, Michael Chen <g.lixu...@gmail.com> wrote:

Hi Nathan,

Only one DRPC server(ip:10.0.0.24), two supervisors(ip:10.0.0.24,
10.0.0.25), one nimbus(ip:10.0.0.24).

One case:
If a topology set numWorkers is 5, but workers of the topology is
assigned on one machine(op:10.0.0.24) and another machine(ip:
10.0.0.25),
one machine(ip:10.0.0.24) is assigned 2 workers, another machine is
assigned 3 workers. then the DRPC client failed call DRPC server
function.

Another case:
When the topology is assigned on all workers on the same machine(ip:
10.0.0.24 or ip:10.0.0.25), then this problem does not occur, call is
successful.

Look forward to your reply. thanks.

On 12月6日, 下午1时32分, nathanmarz <nathan.m...@gmail.com> wrote: