--
You received this message because you are subscribed to the Google Groups "Camus - Kafka ETL for Hadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to camus_etl+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
Over at the Wikimedia Foundation, we're trying to figure out the best way to do our ETL from Kafka into Hadoop. We don't currently use Avro and I'm not sure if we are going to. I came across this post.
If the plan is to remove the hadoop-consumer from Kafka contrib, do you think we should not consider it as one of our viable options?
Thanks!
-Andrew
So is the official direction based on this discussion to ditch the Kafka contrib code and direct people to use Camus without Avro as Ken described or are both solutions going to survive?
I can put time into the contrib code and/or work on documenting the tutorial on how to make Camus work without Avro.
Which is the preferred route, for the long term?
Thanks,
Andrew
I am also working on making the Camus fit for Non Avro message for our requirement.
I see you mentioned about this patch (https://github.com/linkedin/camus/commit/87917a2aea46da9d21c8f67129f6463af52f7aa8) which supports custom data writer for Camus. But this patch is not pulled into camus-kafka-0.8 branch. Is there any plan for doing the same ?
Regards,
Dibyendu
--
You received this message because you are subscribed to a topic in the Google Groups "Camus - Kafka ETL for Hadoop" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/camus_etl/KKS6t5-O-Ng/unsubscribe.
To unsubscribe from this group and all its topics, send an email to camus_etl+...@googlegroups.com.
--
You received this message because you are subscribed to the Google Groups "Camus - Kafka ETL for Hadoop" group.
To unsubscribe from this group and stop receiving emails from it, send an email to camus_etl+...@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to camus_etl+...@googlegroups.com.
What installs all the kafka dependencies under /usr/share/java?
may merge a bit of your work into bigtop-989 if that's ok with you.
I'll ask on bigtop regarding the .deb requirement - it seems they don't abide by this.