0.9.1-incubating and YARN

[Worthy LaFollette]

Trying the new 0.9.1-incubating.zip file and getting this error below.   Any ideas?

********

storm-yarn launch /usr/lib/storm-yarn/apache-storm-0.9.1-incubating/conf/storm.yaml

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/lib/storm-yarn/apache-storm-0.9.1-incubating/lib/logback-classic-1.0.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

14/02/24 17:10:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

14/02/24 17:10:00 INFO client.RMProxy: Connecting to ResourceManager at cplinpyk.xxxxxxxx.com/172.18.138.147:8050

14/02/24 17:10:00 INFO yarn.StormOnYarn: Copy App Master jar from local filesystem and add to local environment

14/02/24 17:10:01 WARN hdfs.BlockReaderLocal: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.

14/02/24 17:10:01 INFO yarn.StormOnYarn: Set the environment for the application master

14/02/24 17:10:01 INFO yarn.StormOnYarn: YARN CLASSPATH COMMAND = [[yarn, classpath]]

14/02/24 17:10:01 INFO yarn.StormOnYarn: YARN CLASSPATH = [/etc/hadoop/conf:/etc/hadoop/conf:/etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/lib/*:/usr/lib/hadoop-mapreduce/.//*::/usr/lib/hadoop-mapreduce/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-yarn/lib/*]

Exception in thread "main" java.lang.RuntimeException: Can not find storm home entry in storm zip file.

at com.yahoo.storm.yarn.Util.getStormHomeInZip(Util.java:115)

at com.yahoo.storm.yarn.StormOnYarn.launchApp(StormOnYarn.java:242)

at com.yahoo.storm.yarn.StormOnYarn.launchApplication(StormOnYarn.java:372)

at com.yahoo.storm.yarn.LaunchCommand.process(LaunchCommand.java:69)

at com.yahoo.storm.yarn.Client.execute(Client.java:142)

at com.yahoo.storm.yarn.Client.main(Client.java:148)

[Bobby Evans]

Incubating changed a few things, and I think one of them was that they changed the packaging from a zip to a tgz.  I am not totally sure what else has happened with it, but it looks like the directory structure may have changed enough that it not longer fits what we expected.

—Bobby

--
You received this message because you are subscribed to the Google Groups "storm-yarn" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-yarn+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Worthy LaFollette]

The issue is that the Util.getStormHomeInZip is looking for the unzipped directory for storm.zip to start with "storm".  The incubating zip, as built, starts with "apache".  The naming change is the cause.  I rebuilt the zip and it seems to be working fine.   But obviously Util.getStormHomeInZip needs to be fixed.

W-

[Bobby Evans]

Yes, if you could file an issue for that documenting what you did to make it work, Hopefully I can find time to make the small change.

—Bobby