at java.io.StringReader.<init>(StringReader.java:50) at org.apache.avro.Schema$Parser.parse(Schema.java:921) at org.apache.avro.Schema.parse(Schema.java:970) at org.apache.avro.mapred.AvroJob.getMapOutputSchema(AvroJob.java:78)
AvroReadExample
https://gist.github.com/3975481
works perfectly now.
But when i include a simple GroupBy and Count into the flow, I get the Schema null exception the from org.apache.avro.mapred.AvroJob.getMapOutputSchema method.
Does this mean i can't directly operate with GroupBy steps on avro input and have to map-only them first?
Cheers and thanks for your time,
Johannes
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/cxqRNHeTOyoJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.
Still..TheAvroReadExample
https://gist.github.com/3975481
works perfectly now.
But when i include a simple GroupBy and Count into the flow,
I get the Schema null exception the from org.apache.avro.mapred.AvroJob.getMapOutputSchema method.
Does this mean i can't directly operate with GroupBy steps on avro input and have to map-only them first?
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/GZuBXXRZNhMJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.
Great Chris,I'll try it. I did basically the same modification locally and it worked perfectly.By the way, is anybody interested in a LocalAvroScheme? Since I like to develop cascading flows locally, i hacked that together. It's not a big deal though
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/fzx8rJTELDcJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.
The common parts woul have to be factored out probably. It's basically just using the local counterparts of the scheme (Properties instead of JobConf)and a avro DataFileStream for reading the data.As I'm fairly new to cascading I don't know if everything is perfect but at least it works in the unit tests..
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/dPeeHgk5wLkJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.
Great Chris,I'll try it. I did basically the same modification locally and it worked perfectly.By the way, is anybody interested in a LocalAvroScheme? Since I like to develop cascading flows locally, i hacked that together. It's not a big deal though
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/fzx8rJTELDcJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.
java.lang.NullPointerException at java.io.StringReader.<init>(StringReader.java:33) at org.apache.avro.Schema$Parser.parse(Schema.java:971) at org.apache.avro.Schema.parse(Schema.java:1020) at org.apache.avro.mapred.AvroJob.getMapOutputSchema(AvroJob.java:78) at org.apache.avro.mapred.AvroKeyComparator.setConf(AvroKeyComparator.java:39) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:773) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:959) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:428) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) at org.apache.hadoop.mapred.Child.main(Child.java:249)
--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.