weird error on cluster

38 views
Skip to first unread message

Alex Cozzi

unread,
May 1, 2013, 12:17:50 AM5/1/13
to scoobi...@googlegroups.com
Something in the latest snapshot must have broken the classloading in scoobi. I am running as usual from a fat-jar and yes, the fat-jar contains the kiama library:
     0 Tue Apr 30 21:08:46 GMT-07:00 2013 META-INF/
   106 Tue Apr 30 21:08:44 GMT-07:00 2013 META-INF/MANIFEST.MF
     0 Tue Apr 30 21:08:46 GMT-07:00 2013 lib/
834115 Tue Apr 30 20:07:38 GMT-07:00 2013 lib/platform-scoobi-1.0-20130430.043106-65.jar
7137903 Thu Apr 04 20:49:58 GMT-07:00 2013 lib/scala-library-2.10.1.jar
2725673 Tue Apr 30 20:07:38 GMT-07:00 2013 lib/platform-1.0-20130430.043105-65.jar
199373 Fri Apr 13 13:25:34 GMT-07:00 2012 lib/jackson-core-asl-1.6.0.jar
535452 Fri Apr 13 13:25:34 GMT-07:00 2012 lib/jackson-mapper-asl-1.6.0.jar
163151 Wed Dec 05 09:44:28 GMT-07:00 2012 lib/commons-io-2.1.jar
  7669 Fri Apr 13 01:23:56 GMT-07:00 2012 lib/slf4j-simple-1.6.1.jar
 25496 Fri Apr 13 01:24:06 GMT-07:00 2012 lib/slf4j-api-1.6.1.jar
116316 Fri Apr 05 15:17:14 GMT-07:00 2013 lib/nscala-time_2.10-0.4.0.jar
573912 Fri Apr 05 15:17:14 GMT-07:00 2013 lib/joda-time-2.2.jar
 38460 Mon Jan 14 16:23:04 GMT-07:00 2013 lib/joda-convert-1.2.jar
391834 Fri Apr 13 01:24:04 GMT-07:00 2012 lib/log4j-1.2.15.jar
  6619 Tue Jan 22 19:14:46 GMT-07:00 2013 lib/UoMNormalizer-0.0.2-SNAPSHOT.jar
 45944 Fri Apr 13 01:23:54 GMT-07:00 2012 lib/json-20090211.jar
2917869 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scoobi_2.10-0.7.0-cdh3-SNAPSHOT.jar
644148 Sat Apr 14 23:01:22 GMT-07:00 2012 lib/javassist-3.12.1.GA.jar
303139 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/avro-1.7.4.jar
 29555 Fri Apr 13 13:26:00 GMT-07:00 2012 lib/paranamer-2.3.jar
995968 Sat Apr 14 23:01:28 GMT-07:00 2012 lib/snappy-java-1.0.4.1.jar
241367 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/commons-compress-1.4.1.jar
 94672 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/xz-1.0.jar
483453 Fri Apr 05 15:17:14 GMT-07:00 2013 lib/xstream-1.4.4.jar
  7188 Sat Apr 14 23:01:26 GMT-07:00 2012 lib/xmlpull-1.1.3.1.jar
 24956 Sat Apr 14 23:01:26 GMT-07:00 2012 lib/xpp3_min-1.1.4c.jar
542842 Fri Apr 05 15:17:22 GMT-07:00 2013 lib/kiama_2.10-1.5.0-SNAPSHOT.jar
 91225 Fri Apr 05 15:17:14 GMT-07:00 2013 lib/jline-1.0.jar
462985 Fri Apr 05 15:17:20 GMT-07:00 2013 lib/ascii-graphs_2.10.0-0.0.2.jar
8621005 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-core_2.10-7.0.0.jar
287554 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-concurrent_2.10-7.0.0.jar
428820 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-effect_2.10-7.0.0.jar
479753 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-scalacheck-binding_2.10-7.0.0.jar
406456 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-typelevel_2.10-7.0.0.jar
773357 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/scalaz-xml_2.10-7.0.0.jar
840559 Fri Apr 05 15:17:14 GMT-07:00 2013 lib/scalacheck_2.10-1.10.0.jar
  4407 Sat Apr 14 23:01:22 GMT-07:00 2012 lib/test-interface-0.5.jar
451307 Thu Apr 04 20:49:56 GMT-07:00 2013 lib/scala-actors-2.10.0.jar
14384128 Thu Apr 04 20:52:48 GMT-07:00 2013 lib/scala-compiler-2.10.1.jar
3178531 Thu Apr 04 20:52:48 GMT-07:00 2013 lib/scala-reflect-2.10.1.jar
166555 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/avro-mapred-1.7.4.jar
187840 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/avro-ipc-1.7.4.jar
957162 Mon Sep 10 11:26:32 GMT-07:00 2012 lib/netty-3.4.0.Final.jar
449505 Sat Apr 14 23:01:30 GMT-07:00 2012 lib/velocity-1.7.jar
266688 Tue Apr 30 20:14:32 GMT-07:00 2013 lib/avro-ipc-1.7.4-tests.jar
 70758 Tue Apr 30 19:48:50 GMT-07:00 2013 lib/dsprofile_2.10-0.2.0.jar
462519 Tue Apr 30 21:08:42 GMT-07:00 2013 lib/scoobay-1.1-SNAPSHOT.jar
     0 Tue Apr 30 20:15:28 GMT-07:00 2013 com/
     0 Tue Apr 30 20:15:28 GMT-07:00 2013 com/ebay/
     0 Tue Apr 30 20:15:28 GMT-07:00 2013 com/ebay/scoobi/
etc etc

This is the exception

hadoop jar scoobay-1.1-SNAPSHOT-job.jar com.ebay.scoobi.examples.ExposureStats -Dmapred.job.queue.name=myqueue                                   
Exception in thread "main" java.lang.NoClassDefFoundError: org/kiama/attribution/AttributionCore
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at com.nicta.scoobi.impl.ScoobiConfigurationImpl.<init>(ScoobiConfigurationImpl.scala:307)
        at com.nicta.scoobi.impl.ScoobiConfigurations$class.apply(ScoobiConfigurationImpl.scala:337)
        at com.nicta.scoobi.impl.ScoobiConfiguration$.apply(ScoobiConfigurationImpl.scala:342)
        at com.nicta.scoobi.application.ScoobiAppConfiguration$class.configuration(ScoobiAppConfiguration.scala:50)
        at com.ebay.scoobi.examples.ExposureStats$.com$nicta$scoobi$application$ScoobiApp$$super$configuration(ExposureStasts.scala:17)
        at com.nicta.scoobi.application.ScoobiApp$class.configuration(ScoobiApp.scala:52)
        at com.ebay.scoobi.examples.ExposureStats$.configuration$lzycompute(ExposureStasts.scala:17)
        at com.ebay.scoobi.examples.ExposureStats$.configuration(ExposureStasts.scala:17)
        at com.nicta.scoobi.application.ScoobiApp$class.parseHadoopArguments(ScoobiApp.scala:90)
        at com.ebay.scoobi.examples.ExposureStats$.parseHadoopArguments(ExposureStasts.scala:17)
        at com.nicta.scoobi.application.ScoobiApp$class.main(ScoobiApp.scala:74)
        at com.ebay.scoobi.examples.ExposureStats$.main(ExposureStasts.scala:17)
        at com.ebay.scoobi.examples.ExposureStats.main(ExposureStasts.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.ClassNotFoundException: org.kiama.attribution.AttributionCore
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 62 more

Eric Torreborre

unread,
May 1, 2013, 6:55:57 AM5/1/13
to scoobi...@googlegroups.com
Is it possible that you still had the old version of Kiama included in your build?

Alex Cozzi

unread,
May 1, 2013, 12:03:08 PM5/1/13
to scoobi...@googlegroups.com
Yup. Both issues I had were due to an obsolete Kiama library. In order to solve the problem I had to manually remove the kiama library from the maven cache: rm -r ~/.m2/repository/com/googlecode/kiama
it seems that under some condition maven fails to notice that a snapshot release is out of date and you need to force.
Problem solved now,
Thanks!
Alex

Eric Torreborre

unread,
May 1, 2013, 8:10:08 PM5/1/13
to scoobi...@googlegroups.com
Hi Alex,

That's good to know.

BTW, we're still working with the Kiama team to finalise a few things which will make it easier to use in Scoobi. We hope to finish that for the next ScalaDays (where I'll be precisely talking about that subject) so that there will be an official Kiama version to depend on (and hopefully a RC1 for Scoobi).

E>
Reply all
Reply to author
Forward
0 new messages