getting java.lang.VerifyError error while running apache-tez-0.5.2 on pig-0.14

[kunal kumar]

I'm trying to run Apache tez 0.5.2 on Pig-0.14. First I build the tez jars using steps mentioned in this link http://tez.apache.org/install.html. I've checked the tez installation by running the orderedWordCount program. It is running as expected. But when I try to run a pig script (containing a simple 'load' statement followed by a 'dump') i'm getting following error..

Cannot submit DAG
org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown
    at org.apache.tez.client.TezClient.waitTillReady(TezClient.java:603)
    at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:100)
    at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:195)
    at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:159)
    at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:167)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)

Caused by:

Exception in thread "main" java.lang.VerifyError: class org.apache.tez.dag.api.records.DAGProtos$DAGPlan overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2531)
at java.lang.Class.getMethod0(Class.java:2774)
at java.lang.Class.getMethod(Class.java:1663)
at sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)

I've used JDK7, Maven 3 and Protocol Buffers (protoc compiler) 2.5.0 for building the jar package, as mentioned in the above link. Also I've chosen 0.5.2 version of apache tez as the default tez jars in Pig-0.14 distribution comes with this version.

According to the comments mentioned in this link https://code.google.com/p/protobuf/issues/detail?id=484 I need to use the correct protocol buffer jars for compilation. But I am not sure how to get correct library jars together to make this work. Stuck on this for more than a day.

Please help!

[Andre Kelpe]

Hi,

you are on the wrong mailing list. You want to reach out to the pig
community: https://pig.apache.org/mailing_lists.html

- André

> --
> You received this message because you are subscribed to the Google Groups
> "cascading-user" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cascading-use...@googlegroups.com.
> To post to this group, send email to cascadi...@googlegroups.com.
> Visit this group at http://groups.google.com/group/cascading-user.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/cascading-user/99dc71d2-fca3-4fd1-901e-6b1f9fe65983%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



--
André Kelpe
an...@concurrentinc.com
http://concurrentinc.com