java.lang.ArrayStoreException

[Reynold Xin]

Hi,

I saw this today trying to serialize a data structure:

spark.SparkException: Job failed: ResultTask(0, 0) failed: ExceptionFailure(com.esotericsoftware.kryo.KryoException: java.lang.RuntimeException: java.lang.ArrayStoreException: org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils$PrimitiveTypeEntry

Serialization trace:

ois (org.apache.hadoop.hive.serde2.objectinspector.StandardUnionObjectInspector)

fieldObjectInspector (org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector$MyField)

fields (org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector)

array (scala.collection.mutable.ArrayBuffer))

You can find the code for PrimitiveTypeEntry here (You can find all the other relevant classes in the same github repo too):

https://github.com/amplab/hive/blob/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorUtils.java

Any idea what's going on?

[Nate]

Hi,

Seems the wrong type of object is being stuffed into an array. No idea why though. :(

-Nate

--
You received this message because you are subscribed to the "kryo-users" group.
http://groups.google.com/group/kryo-users
---
You received this message because you are subscribed to the Google Groups "kryo-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kryo-users+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Reynold Xin]

Hmmm, any tips on debugging this?

You received this message because you are subscribed to a topic in the Google Groups "kryo-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/kryo-users/tpKcEhXc9QI/unsubscribe?hl=en-US.
To unsubscribe from this group and all its topics, send an email to kryo-users+...@googlegroups.com.

[Nate]

Just the usual, make the smallest reproducible test case possible, set your debugger to break on ArrayStoreException, etc.

-Nate