does zeppelin support cdh hadoop cluster?

[서재권]

hi there i try to use zeppelin on cdh(5.3.1) hadoop cluster

here is my approach

1. zeppelin git version : 7b7adf6ec43f2043e58be3f35e7ba1375623689e

2. build : mvn clean package -Pspark-1.2 -Dhadoop.version=2.5.0-cdh5.3.1 -Phadoop-2.4 -Pyarn -DskipTests

3. cdh hadoop down in this url 

   http://archive.cloudera.com/cdh5/cdh/5/

4. change hadoop conf 

hadoop core-site.xml

   <configuration>            

       <property>

           <name>fs.defaultFS</name>       

           <value>hdfs://namenode:8020</value>

       </property>               

    </configuration>  

 

hadoop yarn-site.xml

   <configuration>            

       <property>

          <name>yarn.resourcemanager.address</name>

          <value>namenode</value>

       </property>               

    </configuration>  

5. change zeppelin xml

   export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64

   export MASTER=yarn-client                 

   export SPARK_YARN_JAR=/spark path/spark-1.2.0-cdh5.3.1/lib/spark-assembly-1.2.0-cdh5.3.1-hadoop2.5.0-cdh5.3.1.jar

6. set hadoop, spark home in env

7. run zeppelin server

if i run zeppelin local mode, it can load data on hdfs and work well

but if i change zeppelin master to yarn-client it doesnt work

here is log

Application application_1425901929983_0003 failed 2 times due to AM Container for appattempt_1425901929983_0003_000002 exited with exitCode: 1 due to: Exception from container-launch. Container id: container_1425901929983_0003_02_000001 Exit code: 1 Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) at org.apache.hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:197) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Container exited with a non-zero exit code 1 .Failing this attempt.. Failing the application.

[Kevin (Sangwoo) Kim]

Zeppelin got some issues with CDH. 

You can monitor the issue here: 

https://github.com/NFLabs/zeppelin/issues/368

BTW, zeppelin groups has moved to apache mailing list. 

http://zeppelin.incubator.apache.org/community.html

I guess it will be better to discuss this in mailing list.

Kevin

2015년 3월 9일 월요일 오후 10시 29분 25초 UTC+9, 서재권 님의 말: