Guava classloader issue?

[Matthew Johnson]

Hi all,

 

I have just come across Spark Notebook, and am loving it – brilliant tool!

 

I am having an issue however with Google Guava and the Cassandra-Spark-Connector. It seems Spark Notebook depends on Guava 14 but the Cassandra-Spark-Connector depends on Guava 16, so I get random errors in my jobs like:

 

15/11/06 14:58:32 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)

java.lang.NoSuchMethodError: com.google.common.reflect.TypeToken.isPrimitive()Z

at com.datastax.driver.core.TypeCodec.<init>(TypeCodec.java:142)

at com.datastax.driver.core.TypeCodec.<init>(TypeCodec.java:136)

at com.datastax.driver.core.TypeCodec$BlobCodec.<init>(TypeCodec.java:609)

 

 

Which I believe are caused by a classloader issue. Has anyone else experienced this? If so, how did you get around it? I tried replacing Guava 14 from the Spark Notebook’s libs folder with Guava 16 but then there is some other method missing that causes Spark Notebook to fail.

 

Any suggestions appreciated!

 

Cheers,

Matt

 

[andy petrella]

Hello,

I'm reading my email backlog.... didn't see this one :-(.

Actually, I saw that problem too with the latest cassandra connector! This is something they **have to fix** otherwise it won't work with spark -- until they upstep this miserable guava deps :-(.

So I'd say, for now, you can use the version just before that worked :-)

hth

--
You received this message because you are subscribed to the Google Groups "spark-notebook-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-notebook-...@googlegroups.com.
To post to this group, send email to spark-not...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/spark-notebook-user/6591d555eefedd5255fbaaad7b9b6964%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--

andy