storm-deploy not launching nimbus (branch 0.8.2)

[Ryan Ebanks]

I did a fresh pull of storm-deploy and tried to launch a cluster using the --start command using --branch 0.8.2.  Storm deploy finishes with out any errors, however nimbus and the UI are not running.  

When I ssh into machine run the command

$> ps aux | grep storm

I get the following output :

root     26396  0.0  0.0  73364  3556 ?        Ss   22:34   0:00 sshd: storm [priv]  

storm    26592  0.0  0.0  73364  1668 ?        S    22:34   0:00 sshd: storm@pts/1   

storm    26593  4.8  0.0  26224  8768 pts/1    Ss   22:34   0:00 -bash

storm    27972  0.0  0.0  11024  1400 ?        S    22:34   0:00 /bin/bash ./run

storm    27973  0.0  0.0  11024  1396 ?        S    22:34   0:00 /bin/bash ./run

storm    27974  0.0  0.0  11024  1400 ?        S    22:34   0:00 /bin/bash ./run

storm    27975  0.0  0.0  31420  6176 ?        S    22:34   0:00 python bin/storm drpc

storm    27976  0.0  0.0  31420  6176 ?        S    22:34   0:00 python bin/storm nimbus

storm    27977  0.0  0.0  31420  6180 ?        S    22:34   0:00 python bin/storm ui

storm    27978  0.0  0.0 4660232 12460 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value java.library.path

storm    27979  0.0  0.0 4660232 12456 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value ui.childopts

storm    27980  0.0  0.0 4660232 12720 ?       Sl   22:34   0:00 java -client -Dstorm.options= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf backtype.storm.command.config_value nimbus.childopts

storm    28005  0.0  0.0  16884  1264 pts/1    R+   22:34   0:00 ps aux

storm    28006  0.0  0.0   8108   932 pts/1    S+   22:34   0:00 grep --color=auto storm

root     29480  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise .

storm    29484  0.0  0.0   4172   424 ?        S    22:29   0:00 supervise .

root     29490  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise /home/storm/ui

root     29491  0.0  0.0  41908  1756 ?        S    22:29   0:00 sudo -u storm -H nohup supervise /home/storm/drpc

storm    29493  0.0  0.0   4172   428 ?        S    22:29   0:00 supervise /home/storm/drpc

storm    29494  0.0  0.0   4172   428 ?        S    22:29   0:00 supervise /home/storm/ui

If I try to launch nimbus manually by going to the 'storm' directory and running the command $> bin/storm nimbus , I get the following output

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/command/config_value

Caused by: java.lang.ClassNotFoundException: backtype.storm.command.config_value

at java.net.URLClassLoader$1.run(URLClassLoader.java:217)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:205)

at java.lang.ClassLoader.loadClass(ClassLoader.java:321)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)

at java.lang.ClassLoader.loadClass(ClassLoader.java:266)

Could not find the main class: backtype.storm.command.config_value. Program will exit.

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/command/config_value

Caused by: java.lang.ClassNotFoundException: backtype.storm.command.config_value

at java.net.URLClassLoader$1.run(URLClassLoader.java:217)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:205)

at java.lang.ClassLoader.loadClass(ClassLoader.java:321)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)

at java.lang.ClassLoader.loadClass(ClassLoader.java:266)

Could not find the main class: backtype.storm.command.config_value. Program will exit.

Running: java -server -Dstorm.options= -Dstorm.home=/home/storm/storm-0.8.2 -Djava.library.path= -Dstorm.conf.file= -cp /home/storm/storm-0.8.2/log4j:/home/storm/storm-0.8.2/conf -Dlogfile.name=nimbus.log -Dlog4j.configuration=storm.log.properties backtype.storm.daemon.nimbus

Exception in thread "main" java.lang.NoClassDefFoundError: backtype/storm/daemon/nimbus

Caused by: java.lang.ClassNotFoundException: backtype.storm.daemon.nimbus

at java.net.URLClassLoader$1.run(URLClassLoader.java:217)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:205)

at java.lang.ClassLoader.loadClass(ClassLoader.java:321)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)

at java.lang.ClassLoader.loadClass(ClassLoader.java:266)

Could not find the main class: backtype.storm.daemon.nimbus. Program will exit.

My guess is that class paths aren't being set correctly somewhere but I am unsure of how to fix this problem.  If anyone else has encountered this problem or could provided information on how to fix it, I would greatly appreciate the help.

Thanks,

Ryan

[Lorcan Coyle]

Hi Ryan,

could you paste in the output of the storm-deploy run?

I'll try to take a look at it in the morning,

Lorcan

--
You received this message because you are subscribed to the Google Groups "storm-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-user+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Ryan Ebanks]

Yeah.  I'll relaunch the cluster and pipe the output to a file.  Thanks for the help.

-Ryan

[Ryan Ebanks]

I attached a file that contains all of the output from running storm-deploy and ends in the error I mentioned.

[Lorcan Coyle]

Hi Ryan,

Sorry about the delay, I've just diagnosed this - storm <0.9.0 requires lein 1.x - causing storm-deploy to fail to setup storm properly (see https://github.com/nathanmarz/storm/blob/0.8.2/project.clj#L2-L4).

I'm putting together a fix now... hope to get something in later today/tomorrow...

Lorcan

[Ryan Ebanks]

Ok.  Thanks for the reply.

Just to clarify, I should be able to use lein 1.X with the current code base and it should work?

Thanks again for looking into this.

-Ryan

[Ryan Ebanks]

That does not work.

*** Warning: This project requires Leiningen version 2.0.0 ***

*** Using version 1.7.1 could cause problems. ***

- Get the latest verison of Leiningen at

- https://github.com/technomancy/leiningen

- Or by executing "lein upgrade"

[Lorcan Coyle]

Hi Ryan,

still working on it... hope to have a fix today.

In the meantime deploying branches master or 0.9.0 should work

Lorcan

[Lorcan Coyle]

Hi Ryan,

I've submitted a pull request that I believe will fix the problem: https://github.com/nathanmarz/storm-deploy/pull/48

Could you confirm that it works for you and report on the pull request?

If it's good we'll get it pulled in quickly.

Best,

Lorcan

[Ryan Ebanks]

I will pull now, and let you know today.  Thanks for jumping on this so quickly.

-Ryan

[Lorcan Coyle]

Hi Ryan,

Did you get a chance to look at that pull request? I'm anxious to get the fix confirmed (if it is a fix) or to improve it (if it's not). 

It looks to me like storm-deploy is broken for storm<0.9.0 without it.

Thanks,

Lorcan