storm-deploy not launching nimbus (branch 0.8.2)

Showing 1-11 of 11 messages
storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/6/13 2:48 PM
I did a fresh pull of storm-deploy and tried to launch a cluster using the --start command using --branch 0.8.2.  Storm deploy finishes with out any errors, however nimbus and the UI are not running.  

When I ssh into machine run the command

$> ps aux | grep storm

I get the following output :

root     26396  0.0  0.0  73364  3556 ?        Ss   22:34   0:00 sshd: storm [priv]  
storm    26592  0.0  0.0  73364  1668 ?        S    22:34   0:00 sshd: storm@pts/1   
storm    26593  4.8  0.0  26224  8768 pts/1    Ss   22:34   0:00 -bash
storm    27972  0.0  0.0  11024  1400 ?        S    22:34   0:00 /bin/bash ./run
storm    27973  0.0  0.0  11024  1396 ?        S    22:34   0:00 /bin/bash ./run
storm    27974  0.0  0.0  11024  1400 ?        S    22:34   0:00 /bin/bash ./run
storm    27975  0.0  0.0  31420  6176 ?        S    22:34   0:00 python bin/storm drpc
storm    27976  0.0  0.0  31420  6176 ?        S    22:34   0:00 python bin/storm nimbus
storm    27977  0.0  0.0  31420  6180 ?        S    22:34   0:00 python bin/storm ui
storm    27978  0.0  0.0 4660232 12460 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value java.library.path
storm    27979  0.0  0.0 4660232 12456 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value ui.childopts
storm    27980  0.0  0.0 4660232 12720 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value nimbus.childopts
storm    28005  0.0  0.0  16884  1264 pts/1    R+   22:34   0:00 ps aux
storm    28006  0.0  0.0   8108   932 pts/1    S+   22:34   0:00 grep --color=auto storm
root     29480  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise .
storm    29484  0.0  0.0   4172   424 ?        S    22:29   0:00 supervise .
root     29490  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise /home/storm/ui
root     29491  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise /home/storm/drpc
storm    29493  0.0  0.0   4172   428 ?        S    22:29   0:00 supervise /home/storm/drpc
storm    29494  0.0  0.0   4172   428 ?        S    22:29   0:00 supervise /home/storm/ui


If I try to launch nimbus manually by going to the 'storm' directory and running the command $> bin/storm nimbus , I get the following output

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/command/config_value
Caused by: java.lang.ClassNotFoundException: backtype.storm.command.config_value
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: backtype.storm.command.config_value. Program will exit.
Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/command/config_value
Caused by: java.lang.ClassNotFoundException: backtype.storm.command.config_value
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: backtype.storm.command.config_value. Program will exit.
Running: java -server -Dstorm.options= -Dstorm.home=/home/storm/storm-0.8.2 -Djava.library.path= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf -Dlogfile.name=nimbus.log -Dlog4j.configuration=storm.log.properties backtype.storm.daemon.nimbus
Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/daemon/nimbus
Caused by: java.lang.ClassNotFoundException: backtype.storm.daemon.nimbus
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: backtype.storm.daemon.nimbus. Program will exit.


My guess is that class paths aren't being set correctly somewhere but I am unsure of how to fix this problem.  If anyone else has encountered this problem or could provided information on how to fix it, I would greatly appreciate the help.

Thanks,

Ryan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Lorcan Coyle 11/6/13 3:23 PM
Hi Ryan,
could you paste in the output of the storm-deploy run?
I'll try to take a look at it in the morning,
Lorcan


--
You received this message because you are subscribed to the Google Groups "storm-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-user+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/6/13 3:26 PM
Yeah.  I'll relaunch the cluster and pipe the output to a file.  Thanks for the help.

-Ryan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/6/13 4:02 PM
I attached a file that contains all of the output from running storm-deploy and ends in the error I mentioned.
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Lorcan Coyle 11/7/13 6:12 AM
Hi Ryan,
Sorry about the delay, I've just diagnosed this - storm <0.9.0 requires lein 1.x - causing storm-deploy to fail to setup storm properly (see https://github.com/nathanmarz/storm/blob/0.8.2/project.clj#L2-L4).
I'm putting together a fix now... hope to get something in later today/tomorrow...
Lorcan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/7/13 7:55 AM
Ok.  Thanks for the reply.

Just to clarify, I should be able to use lein 1.X with the current code base and it should work?

Thanks again for looking into this.

-Ryan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/7/13 8:58 AM
That does not work.

*** Warning: This project requires Leiningen version 2.0.0 ***
*** Using version 1.7.1 could cause problems. ***

- Get the latest verison of Leiningen at
- Or by executing "lein upgrade"
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Lorcan Coyle 11/7/13 9:04 AM
Hi Ryan,
still working on it... hope to have a fix today.
In the meantime deploying branches master or 0.9.0 should work
Lorcan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Lorcan Coyle 11/7/13 10:08 AM
Hi Ryan,
I've submitted a pull request that I believe will fix the problem: https://github.com/nathanmarz/storm-deploy/pull/48
Could you confirm that it works for you and report on the pull request?
If it's good we'll get it pulled in quickly.
Best,
Lorcan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Ryan Ebanks 11/8/13 7:29 AM
I will pull now, and let you know today.  Thanks for jumping on this so quickly.

-Ryan
Re: [storm-user] storm-deploy not launching nimbus (branch 0.8.2) Lorcan Coyle 11/11/13 6:32 AM
Hi Ryan,
Did you get a chance to look at that pull request? I'm anxious to get the fix confirmed (if it is a fix) or to improve it (if it's not). 
It looks to me like storm-deploy is broken for storm<0.9.0 without it.
Thanks,
Lorcan