MongoDB Kafka Source Connector - copy.existing not working

258 views
Skip to first unread message

Rui Leal

unread,
Feb 13, 2020, 8:22:39 AM2/13/20
to mongodb-user
I am running Kafka Source Connector with the intention to extract existing mongo data to Kafka.
I am following the connector documentation and setting the property copy.existing to true. The connector is working fine for data events after the connector initialises (topic is created, new events coming from event stream show up in the topic), BUT no messages related to existing mongo data (either in new topics or the topic configured in the connector) can be seen in Kafka. Does anyone have a clue of why this is happening?
Kafka Connect log does not show any errors. Thank you.
Here's the connector configuration:
{"connector.class": "com.mongodb.kafka.connect.MongoSourceConnector","database": "testuk","topic.prefix": "testing4","name": "MongoSourceTest3","connection.uri": "mongodb://localhost:27017","copy.existing": "true","collection": "assignedTreatmentPlan"}


Rui Leal

unread,
Feb 13, 2020, 10:30:04 AM2/13/20
to mongodb-user
Ok, problem found. I just found out that initial data load is a very recent feature and just came on 1.0.0. I was running 0.0.2.
Reply all
Reply to author
Forward
0 new messages