Status: Accepted
Owner:
gerr...@gmail.com
Labels: Type-Task Priority-Medium
New issue 68 by
gerr...@gmail.com: Kafka Collector
http://code.google.com/p/bigstreams/issues/detail?id=68
Write a kafka collector that reads from a kafka, based on TopicConfig(s).
The data written is sent to a LogFileWriter usint the streams-log project.
This project should run as a rpm and is meant to consume from kafka for
files that will end up in hdfs or other batch storage and that need files
to be partitioned by date-hour, and topic.