0.8-SNAPSHOT

[Koert Kuipers]

i compiled spark 0.8-SNAPSHOT against scala 2.9.2 and distributed it acrosss the cluster. master and slaves all start up fine and the web gui is also there.

however when i try to connect with the spark-shell all the workers register themselves available and then immediately disconnect. i found the error below in the workers logs.... are there dependencies in spark 0.8 that do not run against scala 2.9.2?

thanks! koert

13/06/15 23:04:07 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sp...@192.168.3.166:44472
13/06/15 23:04:07 INFO executor.StandaloneExecutorBackend: Successfully registered with driver
13/06/15 23:04:07 INFO executor.Executor: Using REPL class URI: http://192.168.3.166:33667
Uncaught error from thread [sparkExecutor-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[sparkExecutor]
java.lang.IncompatibleClassChangeError: Implementing class
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.ClassLoader.defineClass1(Native Method)
        at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
        at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
        at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
        at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:171)
        at spark.executor.Executor.createClassLoader(Executor.scala:164)
        at spark.executor.Executor.<init>(Executor.scala:44)
        at spark.executor.StandaloneExecutorBackend$$anonfun$receive$1.apply(StandaloneExecutorBackend.scala:44)
        at spark.executor.StandaloneExecutorBackend$$anonfun$receive$1.apply(StandaloneExecutorBackend.scala:40)
        at akka.actor.Actor$class.apply(Actor.scala:318)
        at spark.executor.StandaloneExecutorBackend.apply(StandaloneExecutorBackend.scala:18)
        at akka.actor.ActorCell.invoke(ActorCell.scala:626)

[Koert Kuipers]

the problem was not spark but a patch i applied

[Jey Kottalam]

Hi Nandu,

The "IncompatibleClassChangeError" can usually be fixed by performing
a clean rebuild. If you're using sbt, the command would be "sbt/sbt
clean package".

Hope that helps,
-Jey

On Thu, Jun 20, 2013 at 2:28 AM, Nandu Jayakumar <junk...@gmail.com> wrote:
> Koert,
>
> I am having a similar issue with
> java.lang.IncompatibleClassChangeError
> and
> scala 2.9.2
> and
> shark
>
> What did you trace it down to in your code?
>
> Thanks,
> --Nandu

> --
> You received this message because you are subscribed to the Google Groups
> "Spark Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to spark-users...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

[Koert Kuipers]

i my case it was asm 3.x and asm 4.x being on classpath