Storm-Yarn for Hadoop 2.4.0

[Gufran Pathan]

Hi,

I am trying to maven-package Storm-Yarn master branch on my cluster which has Hadoop 2.4.0. I'm gettting a compilation error. Logs below:

[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /usr/local/storm/storm-yarn-master/src/main/java/com/yahoo/storm/yarn/StormOnYarn.java:[217,12] error: method addToEnvironment in class Apps cannot be applied to given types;
[ERROR]   required: Map<String,String>,String,String,String
  found: Map<String,String>,String,String
  reason: actual and formal argument lists differ in length
/usr/local/storm/storm-yarn-master/src/main/java/com/yahoo/storm/yarn/StormOnYarn.java:[218,12] error: method addToEnvironment in class Apps cannot be applied to given types;
[ERROR]   required: Map<String,String>,String,String,String
  found: Map<String,String>,String,String
  reason: actual and formal argument lists differ in length
/usr/local/storm/storm-yarn-master/src/main/java/com/yahoo/storm/yarn/StormOnYarn.java:[240,12] error: method addToEnvironment in class Apps cannot be applied to given types;
[ERROR]   required: Map<String,String>,String,String,String
  found: Map<String,String>,String,String
  reason: actual and formal argument lists differ in length
/usr/local/storm/storm-yarn-master/src/main/java/com/yahoo/storm/yarn/StormOnYarn.java:[243,12] error: method addToEnvironment in class Apps cannot be applied to given types;
[ERROR]   required: Map<String,String>,String,String,String
  found: Map<String,String>,String,String
  reason: actual and formal argument lists differ in length
/usr/local/storm/storm-yarn-master/src/main/java/com/yahoo/storm/yarn/StormOnYarn.java:[244,12] error: method addToEnvironment in class Apps cannot be applied to given types;
[INFO] 5 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

It seems that in the addToEnvironment method in the org.apache.hadoop.yarn.util.Apps class, an additional String parameter has been added due to which the compilation fails. 

(yarn.util.Apps in Hadoop 2.3 - https://github.com/apache/hadoop-common/blob/branch-2.3.0/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java and in Hadoop 2.4 - https://github.com/apache/hadoop-common/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java)

Do you have any suggestions on how I can fix this, if at all give a shot at fixing it? Or should I let it be and wait for Hortonworks to release their Storm-on-Yarn version compatible with HDP 2.1. 

Also, does anyone have an idea on when the next HDP version is slated to be released?

Thanks in advance!

Regards,

Gufran Pathan

[Bobby Evans]

This is broken by YARN-1824 (2.4.0) and fixed in YARN-1931, which should be released with 2.4.1 and you might be able to use 2.4.1-SNAPSHOT for.  If you want to change each of those lines to also pass in File.pathSeparator as a third argument that would also work around it, but will break compatibility with earlier versions of YARN.

- Bobby

--
You received this message because you are subscribed to the Google Groups "storm-yarn" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-yarn+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.