spark-notebook deployment on Mesosphere crashes

59 views
Skip to first unread message

armen donigian

unread,
Nov 27, 2015, 1:19:30 PM11/27/15
to spark-notebook-user
But the app deployment failed on slave sandbox due to:

Registered executor on ip-x-x-x-x.us-west-2.compute.internal
Starting task spark-notebook.82af561f-9527-11e5-b2d9-0242eb02f7e1
Forked command at 9332
sh -c 'cd spark-notebook-0.6.0-scala-2.10.4-spark-1.4.0-hadoop-2.4.0 && JAVA_HOME=$(pwd)/jre1.7.0_76 && ./bin/spark-notebook -v -Dmanager.tachyon.enabled=false -Dhttp.port=8899 -J-Xms4000m -J-Xmx4000m -Dmanager.notebooks.custom.sparkConf.spark.mesos.executor.docker.image="mesosphere/spark:1.4.0-rc4-hdfs" -Dmanager.notebooks.custom.sparkConf.spark.master="mesos://zk://master.mesos:2181" -Dmanager.notebooks.custom.sparkConf.spark.mesos.executor.home="/opt/spark/dist"'
No java installations was detected.
Please go to http://www.java.com/getjava/ and download
Command exited with status 1 (pid: 9332)

What is the best way to resolve this? I think it's due to the jre1.7.0_76 reference. 

The public slave node java version is:

~ $ java -version
java version "1.8.0_51"
Java(TM) SE Runtime Environment (build 1.8.0_51-b16)
Java HotSpot(TM) 64-Bit Server VM (build 25.51-b03, mixed mode)

 The public slave node $JAVA_HOME is:

~ $ echo $JAVA_HOME
/opt/mesosphere/active/java/usr/java


Reply all
Reply to author
Forward
0 new messages