no jzmq in java.library.path

[maguoqiang]

hello I run a cluster with five computers,when I commit a
wordCountTopology to the nimbus host it disp that successfully upload
topology ,but when I check the worker-6000.log ,I found a Error ,with
the messge as follow:

I place my jzmq ,zeromq on the location of /opt,with the default
make I add the /usr/local/lib to my /etc/profile and source /etc/
profile ,But Still I meet this Error ,IF you have a solution ,please
give me a replay ,thank you !

Error msg:
2012-01-20 17:16:42 worker [ERROR] Error on initialization of server
mk-worker
java.lang.UnsatisfiedLinkError: no jzmq in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1738)
at java.lang.Runtime.loadLibrary0(Runtime.java:823)
at java.lang.System.loadLibrary(System.java:1028)
at org.zeromq.ZMQ.<clinit>(ZMQ.java:34)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at zilch.mq__init.load(Unknown Source)
at zilch.mq__init.<clinit>(Unknown Source)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at clojure.lang.RT.loadClassForName(RT.java:1578)
at clojure.lang.RT.load(RT.java:399)
at clojure.lang.RT.load(RT.java:381)
at clojure.core$load$fn__4511.invoke(core.clj:4905)
at clojure.core$load.doInvoke(core.clj:4904)

[Umut Gökbayrak]

Have you run a ldconfig as the root user before?

-uG-

[maguoqiang]

Yes ，I run ldconfig ! I have read a lot material with this error and I
try to avoid it ,but still there is something wrong ,
Is there other key point should I do or there is need a sequence with
this problem? 3ks

[Umut Gökbayrak]

Hi Maguoqiang,
Please also check these two conditions;

1. Make sure you have -Djava.library.path=/usr/local/lib at your JVM Opts.

2. Make sure that jzmq library and the jar files are built using the same architecture. I mean 32 bits/64 bits compatibility problem. They have to be built using the same architecture.

Best

[Nathan Marz]

You need to set the "java.library.path" config in the storm.yaml file for your supervisors to be the location of the zmq and jzmq native libs. See https://github.com/nathanmarz/storm/wiki/Setting-up-a-Storm-cluster for more details.

--
Twitter: @nathanmarz
http://nathanmarz.com

[maguoqiang]

3Q,for you reply:
1.I do add the java.library.path in ths storm.yaml
2.I check the bit of my computer an the cluster

/bin/ls: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV),
dynamically linked (uses shared libs), for GNU/Linux 2.6.15, stripped
/bin/ls: ELF 64-bit LSB executable, AMD x86-64, version 1 (SYSV), for
GNU/Linux 2.6.9, dynamically linked (uses shared libs), for GNU/Linux
2.6.9, stripped

so maybe this is the problem ?

On 1月22日, 上午5时37分, Nathan Marz <nathan.m...@gmail.com> wrote:
> You need to set the "java.library.path" config in the storm.yaml file for
> your supervisors to be the location of the zmq and jzmq native libs. Seehttps://github.com/nathanmarz/storm/wiki/Setting-up-a-Storm-clusterfor
> more details.
>

[Nathan Marz]

Can you send me your conf/storm.yaml file on the cluster machine, as well as the contents of the directory you installed jzmq and zmq to?

[Viral Bajaria]

Are you sure you ran ldconfig after installing jzmq ?

On Thu, Mar 14, 2013 at 10:11 AM, Melissa DeLaet <maph...@gmail.com> wrote:

Hi all,

I'm running into the same problem and was wondering if a resolution had been found.

i'm trying to compile storm-0.9.0 on ubuntu in order to try the new metric library with storm-starter.  The java.library.path in defaults.yaml includes a directory with my jzmq libraries in it (/usr/local/lib) and I'm using maven in intelliJ.  My errors are below.

Thanks

Missy

[INFO] --- clojure-maven-plugin:1.3.8:compile (compile) @ storm ---

Compiling backtype.storm.messaging.zmq to /home/maphysics/GitProjects/storm/target/classes

Exception in thread "main" java.lang.UnsatisfiedLinkError: no jzmq in java.library.path, compiling:(zmq.clj:1)

at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3387)

at clojure.lang.Compiler.compile1(Compiler.java:7035)

at clojure.lang.Compiler.compile1(Compiler.java:7025)

at clojure.lang.Compiler.compile(Compiler.java:7097)

at clojure.lang.RT.compile(RT.java:387)

at clojure.lang.RT.load(RT.java:427)

at clojure.lang.RT.load(RT.java:400)

at clojure.core$load$fn__4890.invoke(core.clj:5415)

at clojure.core$load.doInvoke(core.clj:5414)

at clojure.lang.RestFn.invoke(RestFn.java:408)

at clojure.core$load_one.invoke(core.clj:5227)

at clojure.core$compile$fn__4895.invoke(core.clj:5426)

at clojure.core$compile.invoke(core.clj:5425)

at clojure.lang.Var.invoke(Var.java:415)

at clojure.lang.Compile.main(Compile.java:81)

Caused by: java.lang.UnsatisfiedLinkError: no jzmq in java.library.path

at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1856)

at java.lang.Runtime.loadLibrary0(Runtime.java:845)

at java.lang.System.loadLibrary(System.java:1084)

at org.zeromq.ZMQ.<clinit>(ZMQ.java:34)

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:188)

at backtype.storm.messaging.zmq$loading__4784__auto__.invoke(zmq.clj:1)

at clojure.lang.AFn.applyToHelper(AFn.java:159)

at clojure.lang.AFn.applyTo(AFn.java:151)

at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3382)

... 14 more

[INFO] ------------------------------------------------------------------------

--
You received this message because you are subscribed to the Google Groups "storm-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-user+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Mike Frazier]

I do not know whether this thread is still monitored, but I just faced this same error.  Bear in mind that the jzmq jar relies on an underlying native zmq library.  Make sure that both the jzmq jar and underlying native library are *both* on the library path.  [In my case the library path included /usr/local/lib, but the native library was in /usr/lib64 -- a few symbolic links put things in working order.]

[Rekha Gupta]

Hi Mike,

I just came across this email chain, and noticed that you have described about similar issue that I'm experiencing, but on Hadoop set up.
I'm trying to get the JZMQ code working on one of the nodes on Hadoop Cluster. I have necessary native jmzq library files installed under -
/usr/local/lib directory 

Here's the list -
libjzmq.a  libjzmq.la  libjzmq.so  libjzmq.so.0  libjzmq.so.0.0.0  libzmq.a  libzmq.la  libzmq.so  libzmq.so.3  libzmq.so.3.0.0  pkgconfig

In my shell script if I run the Java command below, it works absolutely fine  -

java -Djava.library.path=/usr/local/lib -classpath  class/:lib/:lib/jzmq-2.1.3.jar  bigdat.twitter.queue.TweetOMQSub

But when I run the below command, it throws Exception in thread "main" java.lang.UnsatisfiedLinkError: no jzmq in java.library.path
 
hadoop jar $jarpath bigdat.twitter.queue.TweetOMQSub

I explicitly set the necessary files/Jars in Hadoop Classpath, Opts etc, using Export command

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/lib/"
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/home/rgupta/bdAnalytics/lib/*
export JAVA_LIBRARY_PATH=$JAVA_LIBRARY_PATH:/usr/lib/hadoop/lib/native/:/usr/local/lib/

The source code JAR and jzmq-2.1.3.jar files are present under /home/rgupta/bdAnalytics/lib/ folder on Hadoop node.

Would you be able to suggest what I may be doing wrong here?
Thanks in advance!
Best,
RG

--------------------------------------------------------------------------------------------------------

[ma...@knows.is]

I found this link helpful (especially editing the makefile)

http://stackoverflow.com/questions/12115160/compiling-jzmq-on-ubuntu