kafka replicator connect

92 views
Skip to first unread message

Jalakam Sairam

unread,
May 31, 2018, 4:38:05 PM5/31/18
to Confluent Platform
Hi... i am trying to run kafka replicator connect stand alone mode and i am getting the following message. Not sure if the process is running or if the messages are getting transferred to another pipeline


[2018-05-31 13:32:55,290] INFO Cluster ID: N9bTUZAlTAq5TG7xilgR7Q (org.apache.kafka.clients.Metadata:265)

[2018-05-31 13:33:54,400] INFO WorkerSourceTask{id=replicator-source-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)

[2018-05-31 13:33:54,400] INFO WorkerSourceTask{id=replicator-source-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)

[2018-05-31 13:33:54,424] INFO WorkerSourceTask{id=replicator-source-0} Finished commitOffsets successfully in 24 ms (org.apache.kafka.connect.runtime.WorkerSourceTask:427)

[2018-05-31 13:34:54,425] INFO WorkerSourceTask{id=replicator-source-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)

[2018-05-31 13:34:54,425] INFO WorkerSourceTask{id=replicator-source-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)

[2018-05-31 13:35:54,425] INFO WorkerSourceTask{id=replicator-source-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)

[2018-05-31 13:35:54,426] INFO WorkerSourceTask{id=replicator-source-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)





can anyone help me in solving this issue. 

Thanks,
Sairam

Konstantine Karantasis

unread,
Jun 4, 2018, 11:32:04 AM6/4/18
to confluent...@googlegroups.com

I can't say that something is wrong just by looking at this portion of your logs. It seems there are no messages to replicate. 

Couple of suggestions:

1) Increase your log level to DEBUG (or even TRACE) at your connect worker (connect-log4j.properties). It will be more informative. 
2) Double check how you are selecting the topics you want to replicate (properties: topic.whitelist, topic.regex and topic.blacklist) and whether these topics have any records. 
3) Check that these topics have been created on the destination (an even read them to confirm message replication). 

Hope something of the above helps. 

Konstantine


--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/00682445-7db8-4c7f-bbcc-dab740bb3f9f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages