java.lang.NoClassDefFoundError when trying to include joda library in my scala program

[sathe...@gmail.com]

Hi all,

I have been trying to include joda package in my scala program. It works good in my local machine. But when i try to run it in hadoop machine, it does show NoClassDefFoundError and ClassNotFoundError. Given below is the stacktrace for the issue. I have been using sbt tool to build fat jar. I can see that joda-convert-1.7.jar and joda-time-2.8.1 are added to the fat jar. Any help is appreciated.!

Thanks,

satheesh

scalac -classpath /var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/scald.rb/scala_home/2.10.5/scala-library-2.10.5.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/scald.rb/scala_home/2.10.5/scala-reflect-2.10.5.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/scald.rb/scala_home/2.10.5/scala-compiler-2.10.5.jar:/projects/open_source/scalding/scalding-core/target/scala-2.10/scalding-core-assembly-0.15.1-SNAPSHOT.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/hadoop-core-1.1.2.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-codec-1.8.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-configuration-1.9.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/jackson-asl-0.9.5.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/jackson-mapper-asl-1.9.13.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-lang-2.6.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/slf4j-log4j12-1.6.6.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/log4j-1.2.15.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-httpclient-3.1.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-cli-1.2.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/commons-logging-1.1.1.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/zookeeper-3.3.4.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/joda-time-2.8.1.jar:/var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/maven/joda-convert-1.7.jar -d /var/folders/qx/y3knwcfx5px178kgzh_253rd84018s/T/script-build DailyStatus.scala

rsyncing 4.1K from job-jars/com.user_attributes_analysis.DailyStatus.jar to *.com in background...

Waiting for 1 background thread...

Exception in thread "main" java.lang.Throwable: If you know what exactly caused this error, please consider contributing to GitHub via following link.

https://github.com/twitter/scalding/wiki/Common-Exceptions-and-possible-reasons#javalangclassnotfoundexception

at com.twitter.scalding.Tool$.main(Tool.scala:154)

at com.twitter.scalding.Tool.main(Tool.scala)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

Caused by: java.lang.reflect.InvocationTargetException

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:526)

at com.twitter.scalding.Job$.apply(Job.scala:45)

at com.twitter.scalding.Tool.getJob(Tool.scala:50)

at com.twitter.scalding.Tool.run(Tool.scala:70)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

at com.twitter.scalding.Tool$.main(Tool.scala:150)

... 6 more

Caused by: java.lang.NoClassDefFoundError: org/joda/time/format/DateTimeFormat

at com.user_attributes_analysis.DailyStatus.<init>(DailyStatus.scala:17)

... 15 more

Caused by: java.lang.ClassNotFoundException: org.joda.time.format.DateTimeFormat

at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

at java.lang.ClassLoader.loadClass(ClassLoader.java:425)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)

at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

... 16 more