Error while running storm.starter.WordCountTopology

3,197 views
Skip to first unread message

Manish

unread,
Dec 20, 2011, 4:02:38 AM12/20/11
to storm-user
Hi,

I am new to Storm just trying to understand and run the storm-starter
example WordCount on local host. I am getting following error..

Running: export STORM_JAR=storm-starter-0.0.1-SNAPSHOT.jar; java -
client -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -
cp /home/manish/storm-dev/storm-0.6.0/storm-0.6.0.jar:/home/manish/
storm-dev/storm-0.6.0/lib/hiccup-0.3.6.jar:/home/manish/storm-dev/
storm-0.6.0/lib/jetty-util-6.1.26.jar:/home/manish/storm-dev/
storm-0.6.0/lib/commons-fileupload-1.2.1.jar:/home/manish/storm-dev/
storm-0.6.0/lib/clj-time-0.3.0.jar:/home/manish/storm-dev/storm-0.6.0/
lib/clout-0.4.1.jar:/home/manish/storm-dev/storm-0.6.0/lib/
clojure-1.2.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/slf4j-
api-1.5.8.jar:/home/manish/storm-dev/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/manish/storm-dev/storm-0.6.0/lib/
tools.macro-0.1.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/
jetty-6.1.26.jar:/home/manish/storm-dev/storm-0.6.0/lib/
compojure-0.6.4.jar:/home/manish/storm-dev/storm-0.6.0/lib/
reflectasm-1.01.jar:/home/manish/storm-dev/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/manish/storm-dev/storm-0.6.0/lib/
kryo-1.04.jar:/home/manish/storm-dev/storm-0.6.0/lib/
core.incubator-0.1.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/
log4j-1.2.16.jar:/home/manish/storm-dev/storm-0.6.0/lib/
jline-0.9.94.jar:/home/manish/storm-dev/storm-0.6.0/lib/commons-
codec-1.3.jar:/home/manish/storm-dev/storm-0.6.0/lib/commons-
lang-2.5.jar:/home/manish/storm-dev/storm-0.6.0/lib/commons-
logging-1.1.1.jar:/home/manish/storm-dev/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/ring-
servlet-0.3.11.jar:/home/manish/storm-dev/storm-0.6.0/lib/
jzmq-2.1.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/asm-3.2.jar:/
home/manish/storm-dev/storm-0.6.0/lib/slf4j-log4j12-1.5.8.jar:/home/
manish/storm-dev/storm-0.6.0/lib/clojure-contrib-1.2.0.jar:/home/
manish/storm-dev/storm-0.6.0/lib/carbonite-1.0.0.jar:/home/manish/
storm-dev/storm-0.6.0/lib/minlog-1.2.jar:/home/manish/storm-dev/
storm-0.6.0/lib/httpcore-4.0.1.jar:/home/manish/storm-dev/storm-0.6.0/
lib/commons-io-1.4.jar:/home/manish/storm-dev/storm-0.6.0/lib/ring-
core-0.3.10.jar:/home/manish/storm-dev/storm-0.6.0/lib/
zookeeper-3.3.2.jar:/home/manish/storm-dev/storm-0.6.0/lib/joda-
time-1.6.jar:/home/manish/storm-dev/storm-0.6.0/lib/json-
simple-1.1.jar:/home/manish/storm-dev/storm-0.6.0/lib/servlet-
api-2.5.jar:/home/manish/storm-dev/storm-0.6.0/lib/
httpclient-4.0.1.jar:/home/manish/storm-dev/storm-0.6.0/lib/commons-
exec-1.1.jar:/home/manish/storm-dev/storm-0.6.0/lib/
libthrift7-0.7.0.jar:/home/manish/storm-dev/storm-0.6.0/lib/
junit-3.8.1.jar:storm-starter-0.0.1-SNAPSHOT.jar:/home/manish/.storm:/
home/manish/storm-dev/storm-0.6.0/bin storm.starter.WordCountTopology
0 [main] INFO backtype.storm.zookeeper - Starting inprocess
zookeeper at port 2181 and dir /tmp/
23af594e-862f-46ec-9b89-52bab68ed742
157 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
215 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
221 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
236 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
316 [main] INFO backtype.storm.daemon.supervisor - Starting
supervisor with id 69714b4d-6977-46a1-85de-35e68ef0ea50
329 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
344 [main] INFO backtype.storm.daemon.supervisor - Starting
supervisor with id 9434b025-30f4-4cc2-8b87-7e894d47283c
403 [main] INFO backtype.storm.daemon.nimbus - Received topology
submission for word-count with conf {"topology.kryo.register" nil,
"storm.id" "word-count-1-1324371220", "topology.max.task.parallelism"
3, "topology.debug" true}
548 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:1 timed out
549 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:2 timed out
550 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:3 timed out
551 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:4 timed out
552 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:5 timed out
553 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:6 timed out
554 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:7 timed out
555 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:8 timed out
556 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:9 timed out
558 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324371220:10 timed out
561 [main] INFO backtype.storm.daemon.nimbus - Reassigning word-
count-1-1324371220 to 1 slots
674 [main] INFO backtype.storm.daemon.nimbus - Reassign ids: [1 2 3
4 5 6 7 8 9 10]
691 [main] INFO backtype.storm.daemon.nimbus - Available slots:
(["9434b025-30f4-4cc2-8b87-7e894d47283c" 4]
["9434b025-30f4-4cc2-8b87-7e894d47283c" 5]
["9434b025-30f4-4cc2-8b87-7e894d47283c" 6]
["69714b4d-6977-46a1-85de-35e68ef0ea50" 1]
["69714b4d-6977-46a1-85de-35e68ef0ea50" 2]
["69714b4d-6977-46a1-85de-35e68ef0ea50" 3])
730 [main] INFO backtype.storm.daemon.nimbus - Setting new
assignment for storm id word-count-1-1324371220:
#:backtype.storm.daemon.common.Assignment{:master-code-dir "/tmp/
52f572fd-7260-42dd-9135-54d146f567a9/nimbus/stormdist/word-
count-1-1324371220", :node->host
{"9434b025-30f4-4cc2-8b87-7e894d47283c" "Iris"}, :task->node+port {1
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 2
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 3
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 4
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 5
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 6
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 7
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 8
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 9
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4], 10
["9434b025-30f4-4cc2-8b87-7e894d47283c" 4]}, :task->start-time-secs {1
1324371221, 2 1324371221, 3 1324371221, 4 1324371221, 5 1324371221, 6
1324371221, 7 1324371221, 8 1324371221, 9 1324371221, 10 1324371221}}
746 [main] INFO backtype.storm.daemon.nimbus - Activating word-
count: word-count-1-1324371220
762 [Thread-11] INFO backtype.storm.daemon.supervisor - Downloading
code for storm id word-count-1-1324371220 from /tmp/
52f572fd-7260-42dd-9135-54d146f567a9/nimbus/stormdist/word-
count-1-1324371220
764 [Thread-11] INFO backtype.storm.daemon.supervisor - Copying
resources at jar:file:/home/manish/storm-starter/nathanmarz-storm-
starter-4186391/target/storm-starter-0.0.1-SNAPSHOT.jar!/resources to /
tmp/5e9aa013-a694-4589-af56-c21c02783be5/supervisor/stormdist/word-
count-1-1324371220/resources
765 [Thread-11] ERROR backtype.storm.event - Error when processing
event backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668@7593c366
java.io.FileNotFoundException: Source 'file:/home/manish/storm-starter/
nathanmarz-storm-starter-4186391/target/storm-starter-0.0.1-
SNAPSHOT.jar!/resources' does not exist
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:866)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:770)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:745)
at backtype.storm.daemon.supervisor
$fn__3785.invoke(supervisor.clj:394)
at clojure.lang.MultiFn.invoke(MultiFn.java:171)
at backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668.invoke(supervisor.clj:
263)
at backtype.storm.event$event_manager
$fn__2068$fn__2069.invoke(event.clj:25)
at backtype.storm.event$event_manager
$fn__2068.invoke(event.clj:22)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:636)
769 [Thread-6] INFO backtype.storm.daemon.supervisor - Downloading
code for storm id word-count-1-1324371220 from /tmp/
52f572fd-7260-42dd-9135-54d146f567a9/nimbus/stormdist/word-
count-1-1324371220
771 [Thread-6] INFO backtype.storm.daemon.supervisor - Copying
resources at jar:file:/home/manish/storm-starter/nathanmarz-storm-
starter-4186391/target/storm-starter-0.0.1-SNAPSHOT.jar!/resources to /
tmp/09c8b6c3-b5d1-40c8-8861-224b86c043d4/supervisor/stormdist/word-
count-1-1324371220/resources
771 [Thread-6] ERROR backtype.storm.event - Error when processing
event backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668@65957a34
java.io.FileNotFoundException: Source 'file:/home/manish/storm-starter/
nathanmarz-storm-starter-4186391/target/storm-starter-0.0.1-
SNAPSHOT.jar!/resources' does not exist
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:866)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:770)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:745)
at backtype.storm.daemon.supervisor
$fn__3785.invoke(supervisor.clj:394)
at clojure.lang.MultiFn.invoke(MultiFn.java:171)
at backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668.invoke(supervisor.clj:
263)
at backtype.storm.event$event_manager
$fn__2068$fn__2069.invoke(event.clj:25)
at backtype.storm.event$event_manager
$fn__2068.invoke(event.clj:22)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:636)
817 [Thread-6] INFO backtype.storm.util - Halting process: ("Error
when processing an event")
817 [Thread-11] INFO backtype.storm.util - Halting process: ("Error
when processing an event")


Not sure what is wrong please help me in debugging this.

Thanks,
Manish

Nathan Marz

unread,
Dec 20, 2011, 4:09:10 AM12/20/11
to storm...@googlegroups.com
First off, the "storm" client isn't meant for running things in local mode. You should run things in local mode however you normally run Java code. 

A few questions:

1. What OS are you using?
2. Are you able to run ExclamationTopology?
3. How did you package your jar?
4. Can you try running it with Leiningen, like this:

lein deps
lein compile
lein repl
(storm.starter.WordCountTopology/main nil)

-Nathan
--
Twitter: @nathanmarz
http://nathanmarz.com

Manish

unread,
Dec 20, 2011, 4:54:31 AM12/20/11
to storm-user
Hi Nathan

I am using Linux
Linux Iris 2.6.32.12-0.7-default #1 SMP 2010-05-20 11:14:20 +0200
x86_64 x86_64 x86_64 GNU/Linux.

I am using your storm-starter example I have compiled in using maven
and it has created two jars storm-starter-0.0.1-SNAPSHOT.jar and storm-
starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar in target dirtectory.
I have installed storm 0.6.0 and added bin in path and then ran the
following command

/storm-starter/nathanmarz-storm-starter-4186391/target> storm jar
storm-starter-0.0.1-SNAPSHOT.jar storm.starter.Word.Count.Topology

Then it gave the error.

same error is coming when I am running
/storm-starter/nathanmarz-storm-starter-4186391/target> storm jar
storm-starter-0.0.1-SNAPSHOT.jar storm.starter.ExclamationTopology

"906 [Thread-11] ERROR backtype.storm.event - Error when processing
event backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668@68c95daa


java.io.FileNotFoundException: Source 'file:/home/manish/storm-starter/
nathanmarz-storm-starter-4186391/target/storm-starter-0.0.1-
SNAPSHOT.jar!/resources' does not exist
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:866)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:770)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:745)
at backtype.storm.daemon.supervisor
$fn__3785.invoke(supervisor.clj:394)
at clojure.lang.MultiFn.invoke(MultiFn.java:171)
at backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668.invoke(supervisor.clj:
263)
at backtype.storm.event$event_manager
$fn__2068$fn__2069.invoke(event.clj:25)
at backtype.storm.event$event_manager
$fn__2068.invoke(event.clj:22)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:636)

915 [Thread-6] INFO backtype.storm.daemon.supervisor - Downloading
code for storm id test-1-1324374200 from /tmp/649e2c3f-c2d6-4c2a-
b0c5-96957195e503/nimbus/stormdist/test-1-1324374200
916 [Thread-6] INFO backtype.storm.daemon.supervisor - Copying


resources at jar:file:/home/manish/storm-starter/nathanmarz-storm-
starter-4186391/target/storm-starter-0.0.1-SNAPSHOT.jar!/resources to /

tmp/f204f794-9e0f-45e9-a2b2-f3dc93b371dd/supervisor/stormdist/
test-1-1324374200/resources
916 [Thread-6] ERROR backtype.storm.event - Error when processing
event backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668@711b50a1


java.io.FileNotFoundException: Source 'file:/home/manish/storm-starter/
nathanmarz-storm-starter-4186391/target/storm-starter-0.0.1-
SNAPSHOT.jar!/resources' does not exist
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:866)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:770)
at
org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:745)
at backtype.storm.daemon.supervisor
$fn__3785.invoke(supervisor.clj:394)
at clojure.lang.MultiFn.invoke(MultiFn.java:171)
at backtype.storm.daemon.supervisor
$fn__3567$exec_fn__945__auto____3568$this__3668.invoke(supervisor.clj:
263)
at backtype.storm.event$event_manager
$fn__2068$fn__2069.invoke(event.clj:25)
at backtype.storm.event$event_manager
$fn__2068.invoke(event.clj:22)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:636)

966 [Thread-6] INFO backtype.storm.util - Halting process: ("Error


when processing an event")

967 [Thread-11] INFO backtype.storm.util - Halting process: ("Error


when processing an event")
"

Running with Lein is giving some other error like
manish@Iris:~/storm-starter/nathanmarz-storm-starter-4186391> lein
deps
Exception in thread "main" java.lang.RuntimeException:
java.io.FileNotFoundException: Could not locate leiningen/core/
user__init.class or leiningen/core/user.clj on classpath:
at clojure.lang.Util.runtimeException(Util.java:165)
at clojure.lang.Compiler.eval(Compiler.java:6476)
at clojure.lang.Compiler.eval(Compiler.java:6455)
at clojure.lang.Compiler.load(Compiler.java:6902)
at clojure.lang.RT.loadResourceScript(RT.java:357)
at clojure.lang.RT.loadResourceScript(RT.java:348)
at clojure.lang.RT.load(RT.java:427)
at clojure.lang.RT.load(RT.java:398)
at clojure.core$load$fn__4610.invoke(core.clj:5386)
at clojure.core$load.doInvoke(core.clj:5385)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.core$load_one.invoke(core.clj:5200)
at clojure.core$load_lib.doInvoke(core.clj:5237)
at clojure.lang.RestFn.applyTo(RestFn.java:142)
at clojure.core$apply.invoke(core.clj:602)
at clojure.core$load_libs.doInvoke(core.clj:5271)
at clojure.lang.RestFn.applyTo(RestFn.java:137)
at clojure.core$apply.invoke(core.clj:602)
at clojure.core$require.doInvoke(core.clj:5352)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.main$main_opt.invoke(main.clj:323)
at clojure.main$main.doInvoke(main.clj:426)
at clojure.lang.RestFn.invoke(RestFn.java:436)
at clojure.lang.Var.invoke(Var.java:409)
at clojure.lang.AFn.applyToHelper(AFn.java:167)
at clojure.lang.Var.applyTo(Var.java:518)
at clojure.main.main(main.java:37)
Caused by: java.io.FileNotFoundException: Could not locate leiningen/
core/user__init.class or leiningen/core/user.clj on classpath:
at clojure.lang.RT.load(RT.java:430)
at clojure.lang.RT.load(RT.java:398)
at clojure.core$load$fn__4610.invoke(core.clj:5386)
at clojure.core$load.doInvoke(core.clj:5385)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.core$load_one.invoke(core.clj:5200)
at clojure.core$load_lib.doInvoke(core.clj:5237)
at clojure.lang.RestFn.applyTo(RestFn.java:142)
at clojure.core$apply.invoke(core.clj:602)
at clojure.core$load_libs.doInvoke(core.clj:5271)
at clojure.lang.RestFn.applyTo(RestFn.java:137)
at clojure.core$apply.invoke(core.clj:602)
at clojure.core$require.doInvoke(core.clj:5352)
at clojure.lang.RestFn.invoke(RestFn.java:457)
at leiningen.main
$eval3$loading__4505__auto____4.invoke(main.clj:1)
at leiningen.main$eval3.invoke(main.clj:1)
at clojure.lang.Compiler.eval(Compiler.java:6465)
... 25 more

I am novice in this. Please help.

Regards,
Manish

> ...
>
> read more »

Nathan Marz

unread,
Dec 20, 2011, 4:57:30 AM12/20/11
to storm...@googlegroups.com
How did you install Leiningen? The error you're getting looks like you cloned the repository, but the way to install it is just to download this script and put it on your PATH:



Manish

unread,
Dec 20, 2011, 5:34:33 AM12/20/11
to storm-user
I have instaleed lein from technomancy link you have mentioned.

I have installed it but created the lein script again and ran lein

getting this error now...

manish@Iris:~/technomancy-leiningen-ac3e84e/bin> lein
Downloading Leiningen now...
% Total % Received % Xferd Average Speed Time Time
Time Current
Dload Upload Total Spent
Left Speed
0 0 0 0 0 0 0 0 --:--:-- 0:00:02
--:--:-- 0
curl: (22) The requested URL returned error: 404
Failed to download https://github.com/downloads/technomancy/leiningen/leiningen--standalone.jar
Exception in thread "main" java.lang.NoClassDefFoundError: clojure/
main
Caused by: java.lang.ClassNotFoundException: clojure.main
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:
336)
Could not find the main class: clojure.main. Program will exit.

> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 5:52:04 AM12/21/11
to storm...@googlegroups.com
That's really strange. I would try deleting all the leiningen stuff currently on your machine and trying again... I've helped a lot of people install Leiningen and there's never been an issue. I noticed that it's using the wrong URL to download, it should be this one: https://github.com/downloads/technomancy/leiningen/leiningen-1.6.2-standalone.jar

Looking again at your error, the main problem is how you're running the topology. Storm is unable to run topologies in local mode when your multilang resources are in a jar (I've opened an issue for this https://github.com/nathanmarz/storm/issues/82). The way local mode is meant to be run is by adding the multilang dir plus all the jars and classfiles to the classpath and running your class with "java". Leiningen will do this for you once you get it set up.

Manish

unread,
Dec 21, 2011, 6:08:39 AM12/21/11
to storm-user
Hi Nathan,

Thanks for the information. I am able to compile with lien now and
able to run using java -cp `lein classpath`
storm.starter.WordCountTopology.
But then I tried to use with storm called lein urbejar and using storm
to run it like "storm jar storm-starter-0.0.1-SNAPSHOT.jar
storm.starter.ExclamationTopology". It is giving following errors

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/
storm/command/config_value
Caused by: java.lang.ClassNotFoundException:
backtype.storm.command.config_value
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:
336)
Could not find the main class: backtype.storm.command.config_value.
Program will exit.
Traceback (most recent call last):
File "/home/manish/storm/nathanmarz-storm-8aed7da/bin/storm", line
142, in <module>
main()
File "/home/manish/storm/nathanmarz-storm-8aed7da/bin/storm", line
139, in main
COMMANDS[COMMAND](*ARGS)
File "/home/manish/storm/nathanmarz-storm-8aed7da/bin/storm", line
69, in jar
childopts="-Dstorm.jar=" + jarfile)
File "/home/manish/storm/nathanmarz-storm-8aed7da/bin/storm", line
59, in exec_storm_class
command = "java " + jvmtype + " -Djava.library.path=" + nativepath
+ " " + childopts + " -cp " + get_classpath(extrajars) + " " + klass +
" " + " ".join(args)
TypeError: cannot concatenate 'str' and 'NoneType' objects


Regards,
Manish

On Dec 21, 3:52 pm, Nathan Marz <nathan.m...@gmail.com> wrote:
> That's really strange. I would try deleting all the leiningen stuff
> currently on your machine and trying again... I've helped a lot of people
> install Leiningen and there's never been an issue. I noticed that it's
> using the wrong URL to download, it should be this one:https://github.com/downloads/technomancy/leiningen/leiningen-1.6.2-st....
>
> Looking again at your error, the main problem is how you're running the
> topology. Storm is unable to run topologies in local mode when your
> multilang resources are in a jar (I've opened an issue for thishttps://github.com/nathanmarz/storm/issues/82). The way local mode is meant
> to be run is by adding the multilang dir plus all the jars and classfiles
> to the classpath and running your class with "java". Leiningen will do this
> for you once you get it set up.
>
>
>
>
>
>
>
> On Tue, Dec 20, 2011 at 2:34 AM, Manish <manishg.onl...@gmail.com> wrote:
> > I have instaleed lein from technomancy link you have mentioned.
>
> > I have installed it but created the lein script again and ran lein
>
> > getting this error now...
>
> > manish@Iris:~/technomancy-leiningen-ac3e84e/bin> lein
> > Downloading Leiningen now...
> >  % Total    % Received % Xferd  Average Speed   Time    Time
> > Time  Current
> >                                 Dload  Upload   Total   Spent
> > Left  Speed
> >  0     0    0     0    0     0      0      0 --:--:--  0:00:02
> > --:--:--     0
> > curl: (22) The requested URL returned error: 404
> > Failed to download
> >https://github.com/downloads/technomancy/leiningen/leiningen--standal...
> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 6:13:31 AM12/21/11
to storm...@googlegroups.com
Can you show me the results of running these commands:

cd `which storm`/../..
ls -R

Manish

unread,
Dec 21, 2011, 6:21:22 AM12/21/11
to storm-user

Output is pwd
/home/manish/storm/nathanmarz-storm-8aed7da
manish@Iris:~/storm/nathanmarz-storm-8aed7da> bash
manish@Iris:~/storm/nathanmarz-storm-8aed7da> cd `which storm` /../..
bash: cd: /home/manish/storm/nathanmarz-storm-8aed7da/bin/storm: Not a
directory


manish@Iris:~/storm/nathanmarz-storm-8aed7da> ls -R
.:
bin conf lib LICENSE.html log4j project.clj README.markdown
src test TODO

./bin:
build_release.sh install_zmq.sh javadoc.sh storm to_maven.sh

./conf:
defaults.yaml log4j.properties storm.yaml.example

./lib:
clojure-1.2.0.jar clojure-contrib-1.2.0.jar dev twitter4j-
core-2.2.5-SNAPSHOT.jar twitter4j-stream-2.2.5-SNAPSHOT.jar

./lib/dev:
asm-3.2.jar commons-exec-1.1.jar
hiccup-0.3.6.jar json-simple-1.1.jar
minlog-1.2.jar slf4j-api-1.5.8.jar
carbonite-1.0.0.jar commons-fileupload-1.2.1.jar
httpclient-4.0.1.jar junit-3.8.1.jar
reflectasm-1.01.jar slf4j-log4j12-1.5.8.jar
clj-time-0.3.0.jar commons-io-1.4.jar
httpcore-4.0.1.jar jvyaml-1.0.0.jar ring-
core-0.3.10.jar storm-0.6.0.jar
clojure-1.2.0.jar commons-lang-2.5.jar
jetty-6.1.26.jar jzmq-2.1.0.jar ring-jetty-
adapter-0.3.11.jar tools.macro-0.1.0.jar
clojure-contrib-1.2.0.jar commons-logging-1.1.1.jar jetty-
util-6.1.26.jar kryo-1.04.jar ring-servlet-0.3.11.jar
zookeeper-3.3.2.jar
clout-0.4.1.jar compojure-0.6.4.jar
jline-0.9.94.jar libthrift7-0.7.0.jar servlet-
api-2.5-20081211.jar
commons-codec-1.3.jar core.incubator-0.1.0.jar joda-
time-1.6.jar log4j-1.2.16.jar servlet-api-2.5.jar

./log4j:
storm.log.properties

./src:
clj dev genthrift.sh jvm multilang py storm.thrift ui

./src/clj:
backtype zilch

./src/clj/backtype:
storm

./src/clj/backtype/storm:
bootstrap.clj cluster.clj config.clj event.clj LocalCluster.clj
log.clj process_simulator.clj testing.clj timer.clj ui
zookeeper.clj
clojure.clj command daemon kryo.clj LocalDRPC.clj
messaging stats.clj thrift.clj tuple.clj util.clj

./src/clj/backtype/storm/command:
activate.clj config_value.clj deactivate.clj kill_topology.clj
rebalance.clj shell_submission.clj

./src/clj/backtype/storm/daemon:
acker.clj common.clj drpc.clj nimbus.clj supervisor.clj task.clj
worker.clj

./src/clj/backtype/storm/messaging:
loader.clj local.clj protocol.clj zmq.clj

./src/clj/backtype/storm/ui:
core.clj helpers.clj

./src/clj/zilch:
mq.clj virtual_port.clj

./src/dev:
resources

./src/dev/resources:
storm.fy storm.py storm.rb tester.fy tester.py tester.rb

./src/jvm:
backtype

./src/jvm/backtype:
storm

./src/jvm/backtype/storm:
clojure Constants.java drpc grouping
ILocalDRPC.java serialization state task
topology utils
Config.java daemon generated ILocalCluster.java
planner spout StormSubmitter.java testing tuple

./src/jvm/backtype/storm/clojure:
ClojureBolt.java ClojureSpout.java

./src/jvm/backtype/storm/daemon:
Shutdownable.java

./src/jvm/backtype/storm/drpc:
CoordinatedBolt.java JoinResult.java
LinearDRPCInputDeclarer.java PrepareRequest.java
DRPCSpout.java KeyedFairBolt.java
LinearDRPCTopologyBuilder.java ReturnResults.java

./src/jvm/backtype/storm/generated:
AlreadyAliveException.java DistributedRPC.java
InvalidTopologyException.java NullStruct.java
StormTopology.java TopologyInfo.java
Bolt.java DRPCExecutionException.java
JavaObjectArg.java RebalanceOptions.java
StreamInfo.java TopologySummary.java
BoltStats.java DRPCRequest.java
JavaObject.java ShellComponent.java
SupervisorSummary.java
ClusterSummary.java ErrorInfo.java
KillOptions.java SpoutSpec.java
TaskSpecificStats.java
ComponentCommon.java GlobalStreamId.java
Nimbus.java SpoutStats.java TaskStats.java
ComponentObject.java Grouping.java
NotAliveException.java StateSpoutSpec.java TaskSummary.java

./src/jvm/backtype/storm/grouping:
CustomStreamGrouping.java

./src/jvm/backtype/storm/planner:
CompoundSpout.java CompoundTask.java TaskBundle.java

./src/jvm/backtype/storm/serialization:
ITupleDeserializer.java KryoTupleDeserializer.java
KryoValuesDeserializer.java SerializationFactory.java
ITupleSerializer.java KryoTupleSerializer.java
KryoValuesSerializer.java

./src/jvm/backtype/storm/spout:
ISpout.java ISpoutOutputCollector.java RawScheme.java Scheme.java
ShellSpout.java SpoutOutputCollector.java

./src/jvm/backtype/storm/state:
IStateSpout.java ISubscribedState.java
StateSpoutOutputCollector.java
IStateSpoutOutputCollector.java ISynchronizeOutputCollector.java
SynchronizeOutputCollector.java

./src/jvm/backtype/storm/task:
IBolt.java IInternalOutputCollector.java IOutputCollector.java
OutputCollectorImpl.java OutputCollector.java ShellBolt.java
TopologyContext.java

./src/jvm/backtype/storm/testing:
AckFailDelegate.java FeederSpout.java
NGrouping.java TestGlobalCount.java
TestSerObject.java TupleCaptureBolt.java
AckTracker.java FixedTuple.java
SpoutTracker.java TestPlannerBolt.java
TestWordCounter.java
BoltTracker.java FixedTupleSpout.java
TestAggregatesCounter.java TestPlannerSpout.java TestWordSpout.java

./src/jvm/backtype/storm/topology:
BasicBoltExecutor.java IBasicBolt.java
IComponent.java IRichBolt.java IRichStateSpout.java
OutputFieldsGetter.java
BasicOutputCollector.java IBasicOutputCollector.java
InputDeclarer.java IRichSpout.java OutputFieldsDeclarer.java
TopologyBuilder.java

./src/jvm/backtype/storm/tuple:
Fields.java MessageId.java Tuple.java Values.java

./src/jvm/backtype/storm/utils:
BufferFileInputStream.java CRC32OutputStream.java
KeyedRoundRobinQueue.java NimbusClient.java
TimeCacheMap.java VersionedStore.java
ClojureTimerTask.java DRPCClient.java
ListDelegate.java RegisteredGlobalState.java
Time.java WritableUtils.java
Container.java InprocMessaging.java
LocalState.java ServiceRegistry.java Utils.java

./src/multilang:
fy py rb

./src/multilang/fy:
storm.fancypack storm.fy

./src/multilang/py:
storm.py

./src/multilang/rb:
storm.rb

./src/py:
__init__.py storm

./src/py/storm:
constants.py DistributedRPC.py DistributedRPC-remote __init__.py
Nimbus.py Nimbus-remote ttypes.py

./src/ui:
public

./src/ui/public:
css js

./src/ui/public/css:
bootstrap-1.1.0.css

./src/ui/public/js:
jquery-1.6.2.min.js jquery.tablesorter.min.js

./test:
clj multilang

./test/clj:
backtype zilch

./test/clj/backtype:
storm

./test/clj/backtype/storm:
cluster_test.clj grouping_test.clj local_state_test.clj
serialization_test.clj versioned_store_test.clj
drpc_test.clj integration_test.clj nimbus_test.clj
supervisor_test.clj

./test/clj/zilch:
test

./test/clj/zilch/test:
mq.clj

./test/multilang:
fy

./test/multilang/fy:
bolt.fy mocks.fy protocol.fy
manish@Iris:~/storm/nathanmarz-storm-8aed7da>


Regards,
Manish
> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 6:22:58 AM12/21/11
to storm...@googlegroups.com
There's no space between `which storm` and /../.. 

I want to see how you installed the Storm client.

Manish

unread,
Dec 21, 2011, 6:31:17 AM12/21/11
to storm-user
manish@Iris:~/storm/nathanmarz-storm-8aed7da> cd `which storm`/../..
bash: cd: /home/manish/storm/nathanmarz-storm-8aed7da/bin/storm/../..:
Not a directory
> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 6:51:49 AM12/21/11
to storm...@googlegroups.com
Please run ls -R /home/manish/storm/nathanmarz-storm-8aed7da

Manish

unread,
Dec 21, 2011, 6:54:27 AM12/21/11
to storm-user
manish@Iris:~/storm/nathanmarz-storm-8aed7da> ls -R /home/manish/storm/
nathanmarz-storm-8aed7da
/home/manish/storm/nathanmarz-storm-8aed7da:
bin conf lib LICENSE.html log4j project.clj README.markdown
src test TODO

/home/manish/storm/nathanmarz-storm-8aed7da/bin:
build_release.sh install_zmq.sh javadoc.sh storm to_maven.sh

/home/manish/storm/nathanmarz-storm-8aed7da/conf:
defaults.yaml log4j.properties storm.yaml.example

/home/manish/storm/nathanmarz-storm-8aed7da/lib:
clojure-1.2.0.jar clojure-contrib-1.2.0.jar dev twitter4j-
core-2.2.5-SNAPSHOT.jar twitter4j-stream-2.2.5-SNAPSHOT.jar

/home/manish/storm/nathanmarz-storm-8aed7da/lib/dev:
asm-3.2.jar commons-exec-1.1.jar
hiccup-0.3.6.jar json-simple-1.1.jar
minlog-1.2.jar slf4j-api-1.5.8.jar
carbonite-1.0.0.jar commons-fileupload-1.2.1.jar
httpclient-4.0.1.jar junit-3.8.1.jar
reflectasm-1.01.jar slf4j-log4j12-1.5.8.jar
clj-time-0.3.0.jar commons-io-1.4.jar
httpcore-4.0.1.jar jvyaml-1.0.0.jar ring-
core-0.3.10.jar storm-0.6.0.jar
clojure-1.2.0.jar commons-lang-2.5.jar
jetty-6.1.26.jar jzmq-2.1.0.jar ring-jetty-
adapter-0.3.11.jar tools.macro-0.1.0.jar
clojure-contrib-1.2.0.jar commons-logging-1.1.1.jar jetty-
util-6.1.26.jar kryo-1.04.jar ring-servlet-0.3.11.jar
zookeeper-3.3.2.jar
clout-0.4.1.jar compojure-0.6.4.jar
jline-0.9.94.jar libthrift7-0.7.0.jar servlet-
api-2.5-20081211.jar
commons-codec-1.3.jar core.incubator-0.1.0.jar joda-
time-1.6.jar log4j-1.2.16.jar servlet-api-2.5.jar

/home/manish/storm/nathanmarz-storm-8aed7da/log4j:
storm.log.properties

/home/manish/storm/nathanmarz-storm-8aed7da/src:
clj dev genthrift.sh jvm multilang py storm.thrift ui

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj:
backtype zilch

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype:
storm

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype/storm:
bootstrap.clj cluster.clj config.clj event.clj LocalCluster.clj
log.clj process_simulator.clj testing.clj timer.clj ui
zookeeper.clj
clojure.clj command daemon kryo.clj LocalDRPC.clj
messaging stats.clj thrift.clj tuple.clj util.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype/storm/
command:
activate.clj config_value.clj deactivate.clj kill_topology.clj
rebalance.clj shell_submission.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype/storm/
daemon:
acker.clj common.clj drpc.clj nimbus.clj supervisor.clj task.clj
worker.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype/storm/
messaging:
loader.clj local.clj protocol.clj zmq.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/backtype/storm/ui:
core.clj helpers.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/clj/zilch:
mq.clj virtual_port.clj

/home/manish/storm/nathanmarz-storm-8aed7da/src/dev:
resources

/home/manish/storm/nathanmarz-storm-8aed7da/src/dev/resources:
storm.fy storm.py storm.rb tester.fy tester.py tester.rb

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm:
backtype

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype:
storm

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm:
clojure Constants.java drpc grouping
ILocalDRPC.java serialization state task
topology utils
Config.java daemon generated ILocalCluster.java
planner spout StormSubmitter.java testing tuple

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
clojure:
ClojureBolt.java ClojureSpout.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
daemon:
Shutdownable.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
drpc:
CoordinatedBolt.java JoinResult.java
LinearDRPCInputDeclarer.java PrepareRequest.java
DRPCSpout.java KeyedFairBolt.java
LinearDRPCTopologyBuilder.java ReturnResults.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
generated:
AlreadyAliveException.java DistributedRPC.java
InvalidTopologyException.java NullStruct.java
StormTopology.java TopologyInfo.java
Bolt.java DRPCExecutionException.java
JavaObjectArg.java RebalanceOptions.java
StreamInfo.java TopologySummary.java
BoltStats.java DRPCRequest.java
JavaObject.java ShellComponent.java
SupervisorSummary.java
ClusterSummary.java ErrorInfo.java
KillOptions.java SpoutSpec.java
TaskSpecificStats.java
ComponentCommon.java GlobalStreamId.java
Nimbus.java SpoutStats.java TaskStats.java
ComponentObject.java Grouping.java
NotAliveException.java StateSpoutSpec.java TaskSummary.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
grouping:
CustomStreamGrouping.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
planner:
CompoundSpout.java CompoundTask.java TaskBundle.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
serialization:
ITupleDeserializer.java KryoTupleDeserializer.java
KryoValuesDeserializer.java SerializationFactory.java
ITupleSerializer.java KryoTupleSerializer.java
KryoValuesSerializer.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
spout:
ISpout.java ISpoutOutputCollector.java RawScheme.java Scheme.java
ShellSpout.java SpoutOutputCollector.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
state:
IStateSpout.java ISubscribedState.java
StateSpoutOutputCollector.java
IStateSpoutOutputCollector.java ISynchronizeOutputCollector.java
SynchronizeOutputCollector.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
task:
IBolt.java IInternalOutputCollector.java IOutputCollector.java
OutputCollectorImpl.java OutputCollector.java ShellBolt.java
TopologyContext.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
testing:
AckFailDelegate.java FeederSpout.java
NGrouping.java TestGlobalCount.java
TestSerObject.java TupleCaptureBolt.java
AckTracker.java FixedTuple.java
SpoutTracker.java TestPlannerBolt.java
TestWordCounter.java
BoltTracker.java FixedTupleSpout.java
TestAggregatesCounter.java TestPlannerSpout.java TestWordSpout.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
topology:
BasicBoltExecutor.java IBasicBolt.java
IComponent.java IRichBolt.java IRichStateSpout.java
OutputFieldsGetter.java
BasicOutputCollector.java IBasicOutputCollector.java
InputDeclarer.java IRichSpout.java OutputFieldsDeclarer.java
TopologyBuilder.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
tuple:
Fields.java MessageId.java Tuple.java Values.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/jvm/backtype/storm/
utils:
BufferFileInputStream.java CRC32OutputStream.java
KeyedRoundRobinQueue.java NimbusClient.java
TimeCacheMap.java VersionedStore.java
ClojureTimerTask.java DRPCClient.java
ListDelegate.java RegisteredGlobalState.java
Time.java WritableUtils.java
Container.java InprocMessaging.java
LocalState.java ServiceRegistry.java Utils.java

/home/manish/storm/nathanmarz-storm-8aed7da/src/multilang:
fy py rb

/home/manish/storm/nathanmarz-storm-8aed7da/src/multilang/fy:
storm.fancypack storm.fy

/home/manish/storm/nathanmarz-storm-8aed7da/src/multilang/py:
storm.py

/home/manish/storm/nathanmarz-storm-8aed7da/src/multilang/rb:
storm.rb

/home/manish/storm/nathanmarz-storm-8aed7da/src/py:
__init__.py storm

/home/manish/storm/nathanmarz-storm-8aed7da/src/py/storm:
constants.py DistributedRPC.py DistributedRPC-remote __init__.py
Nimbus.py Nimbus-remote ttypes.py

/home/manish/storm/nathanmarz-storm-8aed7da/src/ui:
public

/home/manish/storm/nathanmarz-storm-8aed7da/src/ui/public:
css js

/home/manish/storm/nathanmarz-storm-8aed7da/src/ui/public/css:
bootstrap-1.1.0.css

/home/manish/storm/nathanmarz-storm-8aed7da/src/ui/public/js:
jquery-1.6.2.min.js jquery.tablesorter.min.js

/home/manish/storm/nathanmarz-storm-8aed7da/test:
clj multilang

/home/manish/storm/nathanmarz-storm-8aed7da/test/clj:
backtype zilch

/home/manish/storm/nathanmarz-storm-8aed7da/test/clj/backtype:
storm

/home/manish/storm/nathanmarz-storm-8aed7da/test/clj/backtype/storm:
cluster_test.clj grouping_test.clj local_state_test.clj
serialization_test.clj versioned_store_test.clj
drpc_test.clj integration_test.clj nimbus_test.clj
supervisor_test.clj

/home/manish/storm/nathanmarz-storm-8aed7da/test/clj/zilch:
test

/home/manish/storm/nathanmarz-storm-8aed7da/test/clj/zilch/test:
mq.clj

/home/manish/storm/nathanmarz-storm-8aed7da/test/multilang:
fy

/home/manish/storm/nathanmarz-storm-8aed7da/test/multilang/fy:
bolt.fy mocks.fy protocol.fy
manish@Iris:~/storm/nathanmarz-storm-8aed7da>


> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 6:57:23 AM12/21/11
to storm...@googlegroups.com, storm-user
You've incorrectly installed the Storm client. Download a Storm release from the downloads page, unpack it, and put the extracted bin/ dir on your PATH.

Manish

unread,
Dec 21, 2011, 7:11:50 AM12/21/11
to storm-user
Hi Nathan,

I have downloaded nathanmarz-storm-340dedc.zip from the link and
unzipped it and put the bin in the PATH then I run lein deps and then
lein compile for storm

lein compile is failing.

manish@Iris:~/nathanmarz-storm-340dedc> lein deps
Downloading: org/yaml/snakeyaml/1.9/snakeyaml-1.9.pom from repository
central at http://repo1.maven.org/maven2
Downloading: org/apache/httpcomponents/httpclient/4.1.1/
httpclient-4.1.1.pom from repository central at http://repo1.maven.org/maven2
Downloading: org/apache/httpcomponents/httpcomponents-client/4.1.1/
httpcomponents-client-4.1.1.pom from repository central at
http://repo1.maven.org/maven2
Downloading: org/apache/httpcomponents/project/4.1.1/project-4.1.1.pom
from repository central at http://repo1.maven.org/maven2
Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.pom
from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'org.apache.httpcomponents:httpcore:pom:
4.1' in repository clojars (http://clojars.org/repo/)
Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.pom
from repository sonatype at http://oss.sonatype.org/content/groups/public/
Downloading: org/apache/httpcomponents/httpcomponents-core/4.1/
httpcomponents-core-4.1.pom from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource
'org.apache.httpcomponents:httpcomponents-core:pom:4.1' in repository
clojars (http://clojars.org/repo/)
Downloading: org/apache/httpcomponents/httpcomponents-core/4.1/
httpcomponents-core-4.1.pom from repository sonatype at
http://oss.sonatype.org/content/groups/public/
Downloading: org/apache/httpcomponents/httpclient/4.1.1/
httpclient-4.1.1.jar from repository central at http://repo1.maven.org/maven2
Downloading: commons-codec/commons-codec/1.4/commons-codec-1.4.jar
from repository clojars at http://clojars.org/repo/
Downloading: org/yaml/snakeyaml/1.9/snakeyaml-1.9.jar from repository
central at http://repo1.maven.org/maven2
Unable to locate resource in repository
[INFO] Unable to find resource 'commons-codec:commons-codec:jar:1.4'
in repository clojars (http://clojars.org/repo/)
Downloading: commons-codec/commons-codec/1.4/commons-codec-1.4.jar
from repository sonatype at http://oss.sonatype.org/content/groups/public/
Transferring 57K from sonatype
Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.jar
from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'org.apache.httpcomponents:httpcore:jar:
4.1' in repository clojars (http://clojars.org/repo/)
Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.jar
from repository sonatype at http://oss.sonatype.org/content/groups/public/
Transferring 177K from sonatype
Copying 39 files to /home/manish/nathanmarz-storm-340dedc/lib
Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.pom
from repository central at http://repo1.maven.org/maven2
Unable to locate resource in repository
[INFO] Unable to find resource 'swank-clojure:swank-clojure:pom:1.2.1'
in repository central (http://repo1.maven.org/maven2)
Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.pom
from repository clojars at http://clojars.org/repo/
Transferring 1K from clojars
Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.pom from
repository central at http://repo1.maven.org/maven2
Unable to locate resource in repository
[INFO] Unable to find resource 'lein-ring:lein-ring:pom:0.4.5' in
repository central (http://repo1.maven.org/maven2)
Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.pom from
repository clojars at http://clojars.org/repo/
Transferring 2K from clojars
Downloading: ring/ring-jetty-adapter/0.3.10/ring-jetty-
adapter-0.3.10.pom from repository clojars at http://clojars.org/repo/
Transferring 2K from clojars
Downloading: ring/ring-servlet/0.3.10/ring-servlet-0.3.10.pom from
repository clojars at http://clojars.org/repo/
Transferring 1K from clojars
Downloading: ring/ring-devel/0.3.10/ring-devel-0.3.10.pom from
repository clojars at http://clojars.org/repo/
Transferring 2K from clojars
Downloading: clj-stacktrace/clj-stacktrace/0.2.2/clj-
stacktrace-0.2.2.pom from repository clojars at http://clojars.org/repo/
Transferring 1K from clojars
Downloading: ring-reload-modified/ring-reload-modified/0.1.1/ring-
reload-modified-0.1.1.pom from repository clojars at http://clojars.org/repo/
Transferring 2K from clojars
Downloading: org/clojure/tools.namespace/0.1.0/
tools.namespace-0.1.0.pom from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'org.clojure:tools.namespace:pom:0.1.0'
in repository clojars (http://clojars.org/repo/)
Downloading: org/clojure/tools.namespace/0.1.0/
tools.namespace-0.1.0.pom from repository sonatype at
http://oss.sonatype.org/content/groups/public/
Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.pom
from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'org.clojure:java.classpath:pom:0.1.0'
in repository clojars (http://clojars.org/repo/)
Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.pom
from repository sonatype at http://oss.sonatype.org/content/groups/public/
Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.jar from
repository central at http://repo1.maven.org/maven2
Downloading: ring/ring-jetty-adapter/0.3.10/ring-jetty-
adapter-0.3.10.jar from repository clojars at http://clojars.org/repo/
Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.jar
from repository central at http://repo1.maven.org/maven2
Downloading: ring-reload-modified/ring-reload-modified/0.1.1/ring-
reload-modified-0.1.1.jar from repository clojars at http://clojars.org/repo/
Downloading: clj-stacktrace/clj-stacktrace/0.2.2/clj-
stacktrace-0.2.2.jar from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'lein-ring:lein-ring:jar:0.4.5' in
repository central (http://repo1.maven.org/maven2)
Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.jar from
repository clojars at http://clojars.org/repo/
Transferring 2K from clojars
Unable to locate resource in repository
[INFO] Unable to find resource 'swank-clojure:swank-clojure:jar:1.2.1'
in repository central (http://repo1.maven.org/maven2)
Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.jar
from repository clojars at http://clojars.org/repo/
Downloading: ring/ring-servlet/0.3.10/ring-servlet-0.3.10.jar from
repository clojars at http://clojars.org/repo/
Transferring 5K from clojars
Transferring 4K from clojars
Transferring 3K from clojars
Transferring 6K from clojars
Downloading: org/clojure/tools.namespace/0.1.0/
tools.namespace-0.1.0.jar from repository clojars at http://clojars.org/repo/
Downloading: ring/ring-devel/0.3.10/ring-devel-0.3.10.jar from
repository clojars at http://clojars.org/repo/
Transferring 6K from clojars
Transferring 41K from clojars
Unable to locate resource in repository
[INFO] Unable to find resource 'org.clojure:tools.namespace:jar:0.1.0'
in repository clojars (http://clojars.org/repo/)
Downloading: org/clojure/tools.namespace/0.1.0/
tools.namespace-0.1.0.jar from repository sonatype at
http://oss.sonatype.org/content/groups/public/
Transferring 3K from sonatype
Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.jar
from repository clojars at http://clojars.org/repo/
Unable to locate resource in repository
[INFO] Unable to find resource 'org.clojure:java.classpath:jar:0.1.0'
in repository clojars (http://clojars.org/repo/)
Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.jar
from repository sonatype at http://oss.sonatype.org/content/groups/public/
Transferring 3K from sonatype
Copying 20 files to /home/manish/nathanmarz-storm-340dedc/lib/dev
manish@Iris:~/nathanmarz-storm-340dedc> lein compile
Compiling 127 source files to /home/manish/nathanmarz-storm-340dedc/
classes
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Compiling backtype.storm.LocalCluster
Compiling backtype.storm.LocalDRPC
Compiling backtype.storm.bootstrap
Compiling backtype.storm.clojure
Compiling backtype.storm.cluster
Compiling backtype.storm.command.activate
Compiling backtype.storm.command.config-value
Compiling backtype.storm.command.deactivate
Compiling backtype.storm.command.kill-topology
Compiling backtype.storm.command.rebalance
Compiling backtype.storm.command.shell-submission
Compiling backtype.storm.config
Compiling backtype.storm.daemon.acker
Compiling backtype.storm.daemon.common
Compiling backtype.storm.daemon.drpc
Compiling backtype.storm.daemon.nimbus
Compiling backtype.storm.daemon.supervisor
Compiling backtype.storm.daemon.task
Compiling backtype.storm.daemon.worker
Compiling backtype.storm.event
Compiling backtype.storm.kryo
Compiling backtype.storm.log
Compiling backtype.storm.messaging.loader
Compiling backtype.storm.messaging.local
Compiling backtype.storm.messaging.protocol
Compiling backtype.storm.messaging.zmq
1 [main] ERROR org.apache.zookeeper.server.NIOServerCnxn - Thread
Thread[main,5,main] died
java.lang.UnsatisfiedLinkError: no jzmq in java.library.path (zmq.clj:
1)
at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:2911)
at clojure.lang.Compiler.compile1(Compiler.java:5933)
at clojure.lang.Compiler.compile1(Compiler.java:5923)
at clojure.lang.Compiler.compile(Compiler.java:5992)
at clojure.lang.RT.compile(RT.java:368)
at clojure.lang.RT.load(RT.java:407)
at clojure.lang.RT.load(RT.java:381)
at clojure.core$load$fn__4511.invoke(core.clj:4905)
at clojure.core$load.doInvoke(core.clj:4904)
at clojure.lang.RestFn.invoke(RestFn.java:409)
at clojure.core$load_one.invoke(core.clj:4729)
at clojure.core$compile$fn__4516.invoke(core.clj:4916)
at clojure.core$compile.invoke(core.clj:4915)
at user$eval27.invoke(NO_SOURCE_FILE:1)
at clojure.lang.Compiler.eval(Compiler.java:5424)
at clojure.lang.Compiler.eval(Compiler.java:5415)
at clojure.lang.Compiler.eval(Compiler.java:5391)
at clojure.core$eval.invoke(core.clj:2382)
at clojure.main$eval_opt.invoke(main.clj:235)
at clojure.main$initialize.invoke(main.clj:254)
at clojure.main$null_opt.invoke(main.clj:279)
at clojure.main$main.doInvoke(main.clj:354)
at clojure.lang.RestFn.invoke(RestFn.java:422)
at clojure.lang.Var.invoke(Var.java:369)
at clojure.lang.AFn.applyToHelper(AFn.java:165)
at clojure.lang.Var.applyTo(Var.java:482)
at clojure.main.main(main.java:37)
Caused by: java.lang.UnsatisfiedLinkError: no jzmq in
java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1698)
at java.lang.Runtime.loadLibrary0(Runtime.java:840)
at java.lang.System.loadLibrary(System.java:1047)
at org.zeromq.ZMQ.<clinit>(ZMQ.java:34)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at clojure.lang.RT.classForName(RT.java:1566)
at clojure.lang.Compiler$ImportExpr.eval(Compiler.java:604)
at clojure.lang.Compiler.compile1(Compiler.java:5933)
at clojure.lang.Compiler.compile1(Compiler.java:5923)
at clojure.lang.Compiler.compile1(Compiler.java:5923)
at clojure.lang.Compiler.compile(Compiler.java:5992)
at clojure.lang.RT.compile(RT.java:368)
at clojure.lang.RT.load(RT.java:407)
at clojure.lang.RT.load(RT.java:381)
at clojure.core$load$fn__4511.invoke(core.clj:4905)
at clojure.core$load.doInvoke(core.clj:4904)
at clojure.lang.RestFn.invoke(RestFn.java:409)
at clojure.core$load_one.invoke(core.clj:4729)
at clojure.core$load_lib.doInvoke(core.clj:4766)
at clojure.lang.RestFn.applyTo(RestFn.java:143)
at clojure.core$apply.invoke(core.clj:542)
at clojure.core$load_libs.doInvoke(core.clj:4800)
at clojure.lang.RestFn.applyTo(RestFn.java:138)
at clojure.core$apply.invoke(core.clj:542)
at clojure.core$require.doInvoke(core.clj:4869)
at clojure.lang.RestFn.invoke(RestFn.java:422)
at backtype.storm.messaging.zmq
$loading__4410__auto__.invoke(zmq.clj:1)
at clojure.lang.AFn.applyToHelper(AFn.java:159)
at clojure.lang.AFn.applyTo(AFn.java:151)
at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:2906)
... 26 more
Compilation failed.


Also when I ram the storm-starter it is giving me this error again...
manish@Iris:~/storm-starter/nathanmarz-storm-starter-4186391> storm
jar storm-starter-0.0.1-SNAPSHOT.jar
storm.starter.ExclamationTopology

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/
storm/command/config_value
Caused by: java.lang.ClassNotFoundException:
backtype.storm.command.config_value
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:
294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:
336)
Could not find the main class: backtype.storm.command.config_value.
Program will exit.
Traceback (most recent call last):
File "/home/manish/nathanmarz-storm-340dedc/bin/storm", line 142, in
<module>
main()
File "/home/manish/nathanmarz-storm-340dedc/bin/storm", line 139, in
main
COMMANDS[COMMAND](*ARGS)
File "/home/manish/nathanmarz-storm-340dedc/bin/storm", line 69, in
jar
childopts="-Dstorm.jar=" + jarfile)
File "/home/manish/nathanmarz-storm-340dedc/bin/storm", line 59, in
exec_storm_class
command = "java " + jvmtype + " -Djava.library.path=" + nativepath
+ " " + childopts + " -cp " + get_classpath(extrajars) + " " + klass +
" " + " ".join(args)
TypeError: cannot concatenate 'str' and 'NoneType' objects



On Dec 21, 4:57 pm, Nathan Marz <nathan.m...@gmail.com> wrote:
> You've incorrectly installed the Storm client. Download a Storm release from the downloads page, unpack it, and put the extracted bin/ dir on your PATH.
>
> ...
>
> read more »

Nathan Marz

unread,
Dec 21, 2011, 7:17:10 AM12/21/11
to storm...@googlegroups.com, storm-user
The releases are located here: https://github.com/nathanmarz/storm/downloads

Manish

unread,
Dec 21, 2011, 7:26:37 AM12/21/11
to storm-user
Thanks Nathan. I downloaded that added in the path. Now I am running
storm-starter

manish@Iris:~/storm-starter> storm jar storm-starter-0.0.1-
SNAPSHOT.jar storm.starter.ExclamationTopology

It is working fine

But when I am running

manish@Iris:~/storm-starter/nathanmarz-storm-starter-4186391> storm
jar storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology

I am getting following output


Running: export STORM_JAR=storm-starter-0.0.1-SNAPSHOT.jar; java -
client -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -
cp /home/manish/storm-0.6.0/storm-0.6.0.jar:/home/manish/storm-0.6.0/
lib/hiccup-0.3.6.jar:/home/manish/storm-0.6.0/lib/jetty-
util-6.1.26.jar:/home/manish/storm-0.6.0/lib/commons-
fileupload-1.2.1.jar:/home/manish/storm-0.6.0/lib/clj-time-0.3.0.jar:/
home/manish/storm-0.6.0/lib/clout-0.4.1.jar:/home/manish/storm-0.6.0/
lib/clojure-1.2.0.jar:/home/manish/storm-0.6.0/lib/slf4j-
api-1.5.8.jar:/home/manish/storm-0.6.0/lib/ring-jetty-
adapter-0.3.11.jar:/home/manish/storm-0.6.0/lib/tools.macro-0.1.0.jar:/
home/manish/storm-0.6.0/lib/jetty-6.1.26.jar:/home/manish/storm-0.6.0/
lib/compojure-0.6.4.jar:/home/manish/storm-0.6.0/lib/
reflectasm-1.01.jar:/home/manish/storm-0.6.0/lib/servlet-
api-2.5-20081211.jar:/home/manish/storm-0.6.0/lib/kryo-1.04.jar:/home/
manish/storm-0.6.0/lib/core.incubator-0.1.0.jar:/home/manish/
storm-0.6.0/lib/log4j-1.2.16.jar:/home/manish/storm-0.6.0/lib/
jline-0.9.94.jar:/home/manish/storm-0.6.0/lib/commons-codec-1.3.jar:/
home/manish/storm-0.6.0/lib/commons-lang-2.5.jar:/home/manish/
storm-0.6.0/lib/commons-logging-1.1.1.jar:/home/manish/storm-0.6.0/lib/
jvyaml-1.0.0.jar:/home/manish/storm-0.6.0/lib/ring-servlet-0.3.11.jar:/
home/manish/storm-0.6.0/lib/jzmq-2.1.0.jar:/home/manish/storm-0.6.0/
lib/asm-3.2.jar:/home/manish/storm-0.6.0/lib/slf4j-log4j12-1.5.8.jar:/
home/manish/storm-0.6.0/lib/clojure-contrib-1.2.0.jar:/home/manish/
storm-0.6.0/lib/carbonite-1.0.0.jar:/home/manish/storm-0.6.0/lib/
minlog-1.2.jar:/home/manish/storm-0.6.0/lib/httpcore-4.0.1.jar:/home/
manish/storm-0.6.0/lib/commons-io-1.4.jar:/home/manish/storm-0.6.0/lib/
ring-core-0.3.10.jar:/home/manish/storm-0.6.0/lib/zookeeper-3.3.2.jar:/
home/manish/storm-0.6.0/lib/joda-time-1.6.jar:/home/manish/storm-0.6.0/
lib/json-simple-1.1.jar:/home/manish/storm-0.6.0/lib/servlet-
api-2.5.jar:/home/manish/storm-0.6.0/lib/httpclient-4.0.1.jar:/home/
manish/storm-0.6.0/lib/commons-exec-1.1.jar:/home/manish/storm-0.6.0/
lib/libthrift7-0.7.0.jar:/home/manish/storm-0.6.0/lib/
junit-3.8.1.jar:storm-starter-0.0.1-SNAPSHOT.jar:/home/manish/.storm:/
home/manish/storm-0.6.0/bin storm.starter.WordCountTopology
0 [main] INFO backtype.storm.zookeeper - Starting inprocess
zookeeper at port 2181 and dir /tmp/a912e4e5-818e-4eb5-
ac7e-16f66adc6495
144 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
207 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
213 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
228 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
314 [main] INFO backtype.storm.daemon.supervisor - Starting
supervisor with id f84a1568-e72b-4d42-99a9-340bdb517396
325 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper
state update: :connected:none
343 [main] INFO backtype.storm.daemon.supervisor - Starting
supervisor with id ce3f6efc-b8a5-4ea1-9dc3-3b11c42fb6d8
390 [main] INFO backtype.storm.daemon.nimbus - Received topology
submission for word-count with conf {"topology.kryo.register" nil,
"storm.id" "word-count-1-1324469916", "topology.max.task.parallelism"
3, "topology.debug" true}
534 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:1 timed out
535 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:2 timed out
537 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:3 timed out
538 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:4 timed out
540 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:5 timed out
541 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:6 timed out
543 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:7 timed out
544 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:8 timed out
546 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:9 timed out
547 [main] INFO backtype.storm.daemon.nimbus - Task word-
count-1-1324469916:10 timed out
559 [main] INFO backtype.storm.daemon.nimbus - Reassigning word-
count-1-1324469916 to 1 slots
622 [main] INFO backtype.storm.daemon.nimbus - Reassign ids: [1 2 3
4 5 6 7 8 9 10]
657 [main] INFO backtype.storm.daemon.nimbus - Available slots:
(["ce3f6efc-b8a5-4ea1-9dc3-3b11c42fb6d8" 4] ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 5] ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 6] ["f84a1568-
e72b-4d42-99a9-340bdb517396" 1] ["f84a1568-
e72b-4d42-99a9-340bdb517396" 2] ["f84a1568-
e72b-4d42-99a9-340bdb517396" 3])
726 [main] INFO backtype.storm.daemon.nimbus - Setting new
assignment for storm id word-count-1-1324469916:
#:backtype.storm.daemon.common.Assignment{:master-code-dir "/tmp/
fcb2f6c5-8bae-4df4-95c4-94d295391a13/nimbus/stormdist/word-
count-1-1324469916", :node->host {"ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" "Iris"}, :task->node+port {1 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 2 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 3 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 4 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 5 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 6 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 7 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 8 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 9 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4], 10 ["ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8" 4]}, :task->start-time-secs {1
1324469916, 2 1324469916, 3 1324469916, 4 1324469916, 5 1324469916, 6
1324469916, 7 1324469916, 8 1324469916, 9 1324469916, 10 1324469916}}
767 [main] INFO backtype.storm.daemon.nimbus - Activating word-
count: word-count-1-1324469916
783 [Thread-11] INFO backtype.storm.daemon.supervisor - Downloading
code for storm id word-count-1-1324469916 from /tmp/
fcb2f6c5-8bae-4df4-95c4-94d295391a13/nimbus/stormdist/word-
count-1-1324469916
785 [Thread-11] INFO backtype.storm.daemon.supervisor - Finished
downloading code for storm id word-count-1-1324469916 from /tmp/
fcb2f6c5-8bae-4df4-95c4-94d295391a13/nimbus/stormdist/word-
count-1-1324469916
789 [Thread-6] INFO backtype.storm.daemon.supervisor - Downloading
code for storm id word-count-1-1324469916 from /tmp/
fcb2f6c5-8bae-4df4-95c4-94d295391a13/nimbus/stormdist/word-
count-1-1324469916
790 [Thread-6] INFO backtype.storm.daemon.supervisor - Finished
downloading code for storm id word-count-1-1324469916 from /tmp/
fcb2f6c5-8bae-4df4-95c4-94d295391a13/nimbus/stormdist/word-
count-1-1324469916
827 [Thread-12] INFO backtype.storm.daemon.supervisor - Launching
worker with assignment
#:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "word-
count-1-1324469916", :task-ids (1 2 3 4 5 6 7 8 9 10)} for this
supervisor ce3f6efc-b8a5-4ea1-9dc3-3b11c42fb6d8 on port 4 with id
d04f1798-9675-4c8c-9ff2-69acf8142a45
828 [Thread-12] INFO backtype.storm.daemon.worker - Launching
worker for word-count-1-1324469916 on ce3f6efc-
b8a5-4ea1-9dc3-3b11c42fb6d8:4 with id
d04f1798-9675-4c8c-9ff2-69acf8142a45
882 [Thread-12-EventThread] INFO backtype.storm.zookeeper -
Zookeeper state update: :connected:none
1007 [Thread-12] INFO backtype.storm.daemon.task - Loading task
count:1
1143 [Thread-12] INFO backtype.storm.daemon.task - Preparing bolt
count:1
1144 [Thread-12] INFO backtype.storm.daemon.task - Prepared bolt
count:1
1147 [Thread-12] INFO backtype.storm.daemon.task - Finished loading
task count:1
1149 [Thread-12] INFO backtype.storm.daemon.task - Loading task
count:2
1158 [Thread-12] INFO backtype.storm.daemon.task - Preparing bolt
count:2
1159 [Thread-12] INFO backtype.storm.daemon.task - Prepared bolt
count:2
1191 [Thread-12] INFO backtype.storm.daemon.task - Finished loading
task count:2
1193 [Thread-12] INFO backtype.storm.daemon.task - Loading task
count:3
1243 [Thread-12] INFO backtype.storm.daemon.task - Preparing bolt
count:3
1244 [Thread-12] INFO backtype.storm.daemon.task - Prepared bolt
count:3
1283 [Thread-12] INFO backtype.storm.daemon.task - Finished loading
task count:3
1286 [Thread-12] INFO backtype.storm.daemon.task - Loading task
__acker:4
1332 [Thread-12] INFO backtype.storm.daemon.task - Preparing bolt
__acker:4
1353 [Thread-12] INFO backtype.storm.daemon.task - Prepared bolt
__acker:4
1382 [Thread-12] INFO backtype.storm.daemon.task - Finished loading
task __acker:4
1384 [Thread-12] INFO backtype.storm.daemon.task - Loading task
split:5
1434 [Thread-12] INFO backtype.storm.daemon.task - Preparing bolt
split:5
1515 [Thread-12] INFO backtype.storm.util - Halting process: ("Task
died")



Is it correct??

Thanks,
Manish
On Dec 21, 5:17 pm, Nathan Marz <nathan.m...@gmail.com> wrote:
> The releases are located here:https://github.com/nathanmarz/storm/downloads
>
> On Dec 21, 2011, at 4:11 AM, Manish <manishg.onl...@gmail.com> wrote:
>
>
>
>
>
>
>
> > Hi Nathan,
>
> > I have downloaded nathanmarz-storm-340dedc.zip from the link and
> > unzipped it and put the bin in the PATH then I run lein deps and then
> > lein compile for storm
>
> > lein compile is failing.
>
> > manish@Iris:~/nathanmarz-storm-340dedc> lein deps
> > Downloading: org/yaml/snakeyaml/1.9/snakeyaml-1.9.pom from repository
> > central athttp://repo1.maven.org/maven2
> > Downloading: org/apache/httpcomponents/httpclient/4.1.1/
> > httpclient-4.1.1.pom from repository central athttp://repo1.maven.org/maven2
> > Downloading: org/apache/httpcomponents/httpcomponents-client/4.1.1/
> > httpcomponents-client-4.1.1.pom from repository central at
> >http://repo1.maven.org/maven2
> > Downloading: org/apache/httpcomponents/project/4.1.1/project-4.1.1.pom
> > from repository central athttp://repo1.maven.org/maven2
> > Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.pom
> > from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.apache.httpcomponents:httpcore:pom:
> > 4.1' in repository clojars (http://clojars.org/repo/)
> > Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.pom
> > from repository sonatype athttp://oss.sonatype.org/content/groups/public/
> > Downloading: org/apache/httpcomponents/httpcomponents-core/4.1/
> > httpcomponents-core-4.1.pom from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource
> > 'org.apache.httpcomponents:httpcomponents-core:pom:4.1' in repository
> > clojars (http://clojars.org/repo/)
> > Downloading: org/apache/httpcomponents/httpcomponents-core/4.1/
> > httpcomponents-core-4.1.pom from repository sonatype at
> >http://oss.sonatype.org/content/groups/public/
> > Downloading: org/apache/httpcomponents/httpclient/4.1.1/
> > httpclient-4.1.1.jar from repository central athttp://repo1.maven.org/maven2
> > Downloading: commons-codec/commons-codec/1.4/commons-codec-1.4.jar
> > from repository clojars athttp://clojars.org/repo/
> > Downloading: org/yaml/snakeyaml/1.9/snakeyaml-1.9.jar from repository
> > central athttp://repo1.maven.org/maven2
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'commons-codec:commons-codec:jar:1.4'
> > in repository clojars (http://clojars.org/repo/)
> > Downloading: commons-codec/commons-codec/1.4/commons-codec-1.4.jar
> > from repository sonatype athttp://oss.sonatype.org/content/groups/public/
> > Transferring 57K from sonatype
> > Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.jar
> > from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.apache.httpcomponents:httpcore:jar:
> > 4.1' in repository clojars (http://clojars.org/repo/)
> > Downloading: org/apache/httpcomponents/httpcore/4.1/httpcore-4.1.jar
> > from repository sonatype athttp://oss.sonatype.org/content/groups/public/
> > Transferring 177K from sonatype
> > Copying 39 files to /home/manish/nathanmarz-storm-340dedc/lib
> > Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.pom
> > from repository central athttp://repo1.maven.org/maven2
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'swank-clojure:swank-clojure:pom:1.2.1'
> > in repository central (http://repo1.maven.org/maven2)
> > Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.pom
> > from repository clojars athttp://clojars.org/repo/
> > Transferring 1K from clojars
> > Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.pom from
> > repository central athttp://repo1.maven.org/maven2
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'lein-ring:lein-ring:pom:0.4.5' in
> > repository central (http://repo1.maven.org/maven2)
> > Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.pom from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 2K from clojars
> > Downloading: ring/ring-jetty-adapter/0.3.10/ring-jetty-
> > adapter-0.3.10.pom from repository clojars athttp://clojars.org/repo/
> > Transferring 2K from clojars
> > Downloading: ring/ring-servlet/0.3.10/ring-servlet-0.3.10.pom from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 1K from clojars
> > Downloading: ring/ring-devel/0.3.10/ring-devel-0.3.10.pom from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 2K from clojars
> > Downloading: clj-stacktrace/clj-stacktrace/0.2.2/clj-
> > stacktrace-0.2.2.pom from repository clojars athttp://clojars.org/repo/
> > Transferring 1K from clojars
> > Downloading: ring-reload-modified/ring-reload-modified/0.1.1/ring-
> > reload-modified-0.1.1.pom from repository clojars athttp://clojars.org/repo/
> > Transferring 2K from clojars
> > Downloading: org/clojure/tools.namespace/0.1.0/
> > tools.namespace-0.1.0.pom from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.clojure:tools.namespace:pom:0.1.0'
> > in repository clojars (http://clojars.org/repo/)
> > Downloading: org/clojure/tools.namespace/0.1.0/
> > tools.namespace-0.1.0.pom from repository sonatype at
> >http://oss.sonatype.org/content/groups/public/
> > Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.pom
> > from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.clojure:java.classpath:pom:0.1.0'
> > in repository clojars (http://clojars.org/repo/)
> > Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.pom
> > from repository sonatype athttp://oss.sonatype.org/content/groups/public/
> > Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.jar from
> > repository central athttp://repo1.maven.org/maven2
> > Downloading: ring/ring-jetty-adapter/0.3.10/ring-jetty-
> > adapter-0.3.10.jar from repository clojars athttp://clojars.org/repo/
> > Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.jar
> > from repository central athttp://repo1.maven.org/maven2
> > Downloading: ring-reload-modified/ring-reload-modified/0.1.1/ring-
> > reload-modified-0.1.1.jar from repository clojars athttp://clojars.org/repo/
> > Downloading: clj-stacktrace/clj-stacktrace/0.2.2/clj-
> > stacktrace-0.2.2.jar from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'lein-ring:lein-ring:jar:0.4.5' in
> > repository central (http://repo1.maven.org/maven2)
> > Downloading: lein-ring/lein-ring/0.4.5/lein-ring-0.4.5.jar from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 2K from clojars
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'swank-clojure:swank-clojure:jar:1.2.1'
> > in repository central (http://repo1.maven.org/maven2)
> > Downloading: swank-clojure/swank-clojure/1.2.1/swank-clojure-1.2.1.jar
> > from repository clojars athttp://clojars.org/repo/
> > Downloading: ring/ring-servlet/0.3.10/ring-servlet-0.3.10.jar from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 5K from clojars
> > Transferring 4K from clojars
> > Transferring 3K from clojars
> > Transferring 6K from clojars
> > Downloading: org/clojure/tools.namespace/0.1.0/
> > tools.namespace-0.1.0.jar from repository clojars athttp://clojars.org/repo/
> > Downloading: ring/ring-devel/0.3.10/ring-devel-0.3.10.jar from
> > repository clojars athttp://clojars.org/repo/
> > Transferring 6K from clojars
> > Transferring 41K from clojars
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.clojure:tools.namespace:jar:0.1.0'
> > in repository clojars (http://clojars.org/repo/)
> > Downloading: org/clojure/tools.namespace/0.1.0/
> > tools.namespace-0.1.0.jar from repository sonatype at
> >http://oss.sonatype.org/content/groups/public/
> > Transferring 3K from sonatype
> > Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.jar
> > from repository clojars athttp://clojars.org/repo/
> > Unable to locate resource in repository
> > [INFO] Unable to find resource 'org.clojure:java.classpath:jar:0.1.0'
> > in repository clojars (http://clojars.org/repo/)
> > Downloading: org/clojure/java.classpath/0.1.0/java.classpath-0.1.0.jar
> > from repository sonatype athttp://oss.sonatype.org/content/groups/public/
> ...
>
> read more »

Nathan Marz

unread,
Dec 22, 2011, 5:35:31 AM12/22/11
to storm...@googlegroups.com
The "storm" client isn't for running things in local mode. So just stick with the java approach that worked. The "storm" client is for submitting topologies to a remote cluster.

Reply all
Reply to author
Forward
0 new messages