build master edition failed: Could not resolve dependencies

[charles li]

edition: master

command: 

mvn clean package -DskipTests -Dspark.version=1.2.0

error msg:

[INFO] Zeppelin ........................................... SUCCESS [  4.673 s]
[INFO] Zeppelin: Zengine .................................. SUCCESS [  9.339 s]
[INFO] Zeppelin: Spark .................................... FAILURE [07:19 min]
[INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
[INFO] Zeppelin: Shell interpreter ........................ SKIPPED
[INFO] Zeppelin: web Application .......................... SKIPPED
[INFO] Zeppelin: Server ................................... SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] Zeppelin: Documentation ............................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:34 min
[INFO] Finished at: 2015-01-07T17:23:35+08:00
[INFO] Final Memory: 44M/372M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project zeppelin-spark: Could not resolve dependencies for project com.nflabs.zeppelin:zeppelin-spark:jar:0.5.0-SNAPSHOT: Could not find artifact org.apache.spark:spark-repl_2.10:jar:1.2.0 in nflabs public repository (https://raw.github.com/NFLabs/mvn-repo/master/releases) -> [Help 1]

thanks for 

[charles li]

Hello everyone, I think the reason of error showed above was that the spark version too high, so I tried to build with spark 1.1.0, another error occurs again:

command:

mvn clean package -DskipTests -Dspark.version=1.1.0

error msg:

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Zeppelin ........................................... SUCCESS [  4.616 s]
[INFO] Zeppelin: Zengine .................................. SUCCESS [  9.718 s]
[INFO] Zeppelin: Spark .................................... SUCCESS [ 11.480 s]
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [  2.026 s]
[INFO] Zeppelin: Shell interpreter ........................ SUCCESS [  2.356 s]
[INFO] Zeppelin: web Application .......................... SUCCESS [ 37.153 s]
[INFO] Zeppelin: Server ................................... FAILURE [16:08 min]

[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] Zeppelin: Documentation ............................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

[INFO] Total time: 17:15 min
[INFO] Finished at: 2015-01-07T17:44:52+08:00
[INFO] Final Memory: 57M/414M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project zeppelin-server: Could not resolve dependencies for project com.nflabs.zeppelin:zeppelin-server:jar:0.5.0-SNAPSHOT: Could not transfer artifact xalan:xalan:jar:2.7.1 from/to central (https://repo.maven.apache.org/maven2): GET request of: xalan/xalan/2.7.1/xalan-2.7.1.jar from central failed: SSL peer shut down incorrectly -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :zeppelin-server

在 2015年1月7日星期三UTC+8下午5时27分17秒，charles li写道：

[Ophir Cohen]

Hi Guys,
I'm encountering exactly the same issue.
And I have Spark 1.2 cluster on AWS.

So I build Zeppelin with spark 1.1:
mvn install -DskipTests -Dspark.version=1.1.0 -Dhadoop.version=2.4.0
And it finished successfully.
Than, I ran it on my cluster on a local mode. It worked great.
Last I tried to run it with yarn-client and it failed with the following error:
ERROR [2015-01-22 12:49:35,219] ({pool-2-thread-2} Job.java[run]:164) - Job failed
java.lang.NoClassDefFoundError: Could not initialize class org.apache.spark.deploy.SparkHadoopUtil$
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:228)
        at com.nflabs.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:184)
        at com.nflabs.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:118)
        at com.nflabs.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:271)
        at com.nflabs.zeppelin.interpreter.ClassloaderInterpreter.open(ClassloaderInterpreter.java:81)
        at com.nflabs.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:31)

I suspect that this class belongs to Spark 1.2.0...

Any idea what should I do?

Thanks,
Ophir

[Michelle Casbon]

I'm getting the same error:

mvn install clean -DskipTests -Dspark.version=1.2.0 -Dhadoop.version=2.5.0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]


[INFO] Zeppelin .......................................... SUCCESS [6.768s]
[INFO] Zeppelin: Zengine ................................. SUCCESS [19.889s]
[INFO] Zeppelin: Spark ................................... FAILURE [4:40.056s]
[INFO] Zeppelin: Markdown interpreter .................... SKIPPED
[INFO] Zeppelin: Shell interpreter ....................... SKIPPED
[INFO] Zeppelin: web Application ......................... SKIPPED
[INFO] Zeppelin: Server .................................. SKIPPED
[INFO] Zeppelin: Packaging distribution .................. SKIPPED


[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------


[INFO] Total time: 5:07.667s
[INFO] Finished at: Fri Mar 13 13:43:40 CDT 2015
[INFO] Final Memory: 36M/117M


[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project zeppelin-spark: Could not resolve dependencies for project com.nflabs.zeppelin:zeppelin-spark:jar:0.5.0-SNAPSHOT: Could not find artifact org.apache.spark:spark-repl_2.10:jar:1.2.0 in nflabs public repository(https://raw.github.com/NFLabs/mvn-repo/master/releases) -> [Help 1]


Is Zeppelin incompatible with Spark 1.2?

--Michelle

[moon soo Lee]

Hi Michelle,

Zeppelin can be built with Spark 1.2 by giving spark-1.2 profile. By default build with spark-1.2.0 will fail (to use spark 1.2.0 you need build spark 1.2.0 and install artifact in your local m2 repository). So, if possible try spark-1.2.1 with following build command 

mvn install clean -DskipTests -Pspark-1.2 -Dspark.version=1.2.1 -Dhadoop.version=2.5.0

And we have moved mailing list to Apache. Please consider subscribing our new mailing list. 

Check here for more information http://zeppelin.incubator.apache.org/community.html

Thanks,

moon