Failed to load native Mesos library from

[gulei]

Hi,

   I use spark to run PageRank. My program ran well before I changed my cluster to 64 bit system. After I reconfigured my cluster and installed 64 bit system and 64 bit JDK, I encountered the problem below. My program is the same is before and the configuration is also the same. What went wrong ? Can anyone help out?

Failed to load native Mesos library from /home/dummy/.java/jdk1.6.0_45/jre/lib/a

md64/server:/home/dummy/.java/jdk1.6.0_45/jre/lib/amd64:/home/dummy/.java/jdk1.6

.0_45/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/

lib

java.lang.UnsatisfiedLinkError: no mesos in java.library.path

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)

        at java.lang.Runtime.loadLibrary0(Runtime.java:823)

        at java.lang.System.loadLibrary(System.java:1028)

        at org.apache.mesos.MesosNativeLibrary.load(MesosNativeLibrary.java:46)

        at spark.SparkContext.<init>(SparkContext.scala:174)

        at spark.SparkContext.<init>(SparkContext.scala:77)

        at PageRank$.main(PageRank.scala:79)

        at PageRank.main(PageRank.scala)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.

java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces

sorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at scala.tools.nsc.util.ScalaClassLoader$$anonfun$run$1.apply(ScalaClass

Loader.scala:78)

        at scala.tools.nsc.util.ScalaClassLoader$class.asContext(ScalaClassLoade

r.scala:24)

        at scala.tools.nsc.util.ScalaClassLoader$URLClassLoader.asContext(ScalaC

lassLoader.scala:88)

        at scala.tools.nsc.util.ScalaClassLoader$class.run(ScalaClassLoader.scal

a:78)

        at scala.tools.nsc.util.ScalaClassLoader$URLClassLoader.run(ScalaClassLo

ader.scala:101)

        at scala.tools.nsc.ObjectRunner$.run(ObjectRunner.scala:33)

        at scala.tools.nsc.ObjectRunner$.runAndCatch(ObjectRunner.scala:40)

        at scala.tools.nsc.MainGenericRunner.runTarget$1(MainGenericRunner.scala

:56)

        at scala.tools.nsc.MainGenericRunner.process(MainGenericRunner.scala:80)

        at scala.tools.nsc.MainGenericRunner$.main(MainGenericRunner.scala:89)

        at scala.tools.nsc.MainGenericRunner.main(MainGenericRunner.scala)

[gulei]

I want to know what is the  "native Mesos library". Is it a jar package? If it is, where is it? Should I put it into CLASSPATH? By the way, I am using spark 0.6.1.

在 2013年5月16日星期四UTC+8下午10时41分25秒，gulei写道：

[lei gu]

The  problem has been solved. I read this post https://groups.google.com/forum/#!msg/spark-users/RlJpw_YV4PA/J6EED_W6U-MJ and figured out that I need to manually run the spark_env.sh script first before I run my own program. The spark_env.sh script would not run by itself. 

But in my previous running, I didn't run spark_env.sh manually, the program still ran well. I don't know the reason.

2013/5/16 gulei <gulei...@gmail.com>

--
You received this message because you are subscribed to a topic in the Google Groups "Spark Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/spark-users/nTmxF8BeKyg/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to spark-users...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.