Failed to load native Mesos library "UnsatisfiedLinkError: Java expecting version 0.9.0, found version 0.10.0"

[goutam tadi]

Hi All,

Please help me solving this...

My spark-env.sh is:

export MESOS_NATIVE_LIBRARY=/usr/local/lib/libmesos.so
export SCALA_HOME=/root/scala-2.9.2
export MESOS_HOME=/root/mesos-0.10.0


I have recently updated to mesos-0.10.0 after uninstalling and deleting the mesos-0.9.0. But I could not find a way to resolve the following issue when trying to run on a cluster


Failed to load native Mesos library at /usr/local/lib/libmesos.so
Exception in thread "main" java.lang.UnsatisfiedLinkError: Java expecting version 0.9.0, found version 0.10.0

    at java.lang.ClassLoader$NativeLibrary.load(Native Method)
    at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1939)
    at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1864)
    at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1825)
    at java.lang.Runtime.load0(Runtime.java:792)
    at java.lang.System.load(System.java:1059)
    at org.apache.mesos.MesosNativeLibrary.load(MesosNativeLibrary.java:38)
    at spark.SparkContext.<init>(SparkContext.scala:176)
    at spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:508)
    at spark.streaming.StreamingContext.<init>(StreamingContext.scala:64)
    at spark.streaming.examples.Weather1$.main(Weather1.scala:17)
    at spark.streaming.examples.Weather1.main(Weather1.scala)

Thanks in advance,

Goutam

[Matei Zaharia]

Ah, it looks like you have to recompile Spark against Mesos 0.10 unfortunately. Edit project/SparkBuild.scala to change the Mesos version to 0.10.0, and do sbt/sbt clean package to rebuild it.

Matei

--
You received this message because you are subscribed to the Google Groups "Spark Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-users...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[goutam tadi]

Hi Matei,

I have tried doing it by changing the mesos version. But I think the new mesos-0.10.0 jar is not available in any of the repositories mentioned. Help me how I could add a jar.

Thanks
Goutam