ArrayType, MapType and StructureType
We can infer the correct schema for them, but the serialization can not handle them well.
Davies I can see why StructType won't work because of mixed types, but I guess ArrayType and MapType should work ?
AFAIK ArrayType should work as its a list of same type. Similarly I think map type should work but only for string keys.
ArrayType could be c("ab", "ba"), we will serialize it as character.
We does not support deserialize env in R (serialize Map[] in Scala).
So all the three do not work.
Cool thanks for clarifying. Its good to know what needs to be fixed !
Tracked by https://issues.apache.org/jira/browse/SPARK-6819