Kafka connect tutorial stopped working
Ajay Chitre
This is not exactly an issue with Confluent product, but I thought I would ask here anyways -:)
I was following step #7 (Use Kafka Connect to import/export data) at this link:
http://kafka.apache.org/documentation.html#quickstart
It was working well until I deleted the 'test.txt' file. (Mainly because that's how log4j files would work. After certain time, the file will get rotated - I mean - it will be renamed & a new file with the same name will start getting written to.)
But after I deleted 'test.txt', the connector stopped working. I restarted connector, broker, zookeeper etc, but the new lines from 'test.txt' are not going to the 'connect-test' topic & therefore are not going to the 'test.sink.txt' file.
I will start debugging but if anyone knows how to fix this please let me know. Thanks.
Gwen Shapira
Yeah, the file connector in the example is just an example - not
really meant for "real" log monitoring.
If you are looking for more serious log connector, perhaps:
https://github.com/jcustenborder/kafka-connect-spooldir
Will work better?
Gwen
> You received this message because you are subscribed to the Google Groups
> "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to confluent-platf...@googlegroups.com.
> To post to this group, send email to confluent...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/CAMhsnBD1-uHpn%2BZGjOBphmYDht5WBDFO6P%3DToD%2BNaUa1g_2g%3Dw%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.
--
Gwen Shapira
Product Manager | Confluent
650.450.2760 | @gwenshap
Follow us: Twitter | blog