Reading XML File From the FileSystem or HDFS into KAFKA

435 views
Skip to first unread message

Maatary Okouya

unread,
Mar 9, 2017, 6:53:33 PM3/9/17
to Confluent Platform
Is there any Kafka Connector that would enable to read XML content into KAFKA. I have a folder in which XML File get send to continually coming from an upstream system. I wonder if there is a way to ingest them in KAFKA for stream processing.

Gwen Shapira

unread,
Mar 10, 2017, 1:43:53 PM3/10/17
to confluent...@googlegroups.com
We have a spooling directory connector that reads files:

It doesn't do XML specifically, but if you have XML record per line, you can use its "line mode" to get XML to Kafka.

Gwen

On Thu, Mar 9, 2017 at 3:53 PM, Maatary Okouya <maatar...@gmail.com> wrote:
Is there any Kafka Connector that would enable to read XML content into KAFKA. I have a folder in which XML File get send to continually coming from an upstream system. I wonder if there is a way to ingest them in KAFKA for stream processing.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/67a1db6e-6cb3-4100-a568-9ff9a14be0d5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Gwen Shapira
Product Manager | Confluent
650.450.2760 @gwenshap
Follow us: Twitter | blog

Reply all
Reply to author
Forward
0 new messages