i compiled spark 0.8-SNAPSHOT against scala 2.9.2 and distributed it acrosss the cluster. master and slaves all start up fine and the web gui is also there.
however when i try to connect with the spark-shell all the workers register themselves available and then immediately disconnect. i found the error below in the workers logs.... are there dependencies in spark 0.8 that do not run against scala 2.9.2?
13/06/15 23:04:07 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://
sp...@192.168.3.166:44472
13/06/15 23:04:07 INFO executor.StandaloneExecutorBackend: Successfully registered with driver
13/06/15 23:04:07 INFO executor.Executor: Using REPL class URI:
http://192.168.3.166:33667
Uncaught error from thread [sparkExecutor-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[sparkExecutor]
java.lang.IncompatibleClassChangeError: Implementing class
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:171)
at spark.executor.Executor.createClassLoader(Executor.scala:164)
at spark.executor.Executor.<init>(Executor.scala:44)
at spark.executor.StandaloneExecutorBackend$$anonfun$receive$1.apply(StandaloneExecutorBackend.scala:44)
at spark.executor.StandaloneExecutorBackend$$anonfun$receive$1.apply(StandaloneExecutorBackend.scala:40)
at akka.actor.Actor$class.apply(Actor.scala:318)
at spark.executor.StandaloneExecutorBackend.apply(StandaloneExecutorBackend.scala:18)
at akka.actor.ActorCell.invoke(ActorCell.scala:626)