How to deploy debezium on a multi node/broker kafka cluster

Krishnanand Khambadkone

unread,

May 21, 2021, 1:04:59 PM5/21/21

to debezium

Hello, I have been able to successfully install and run Debezium on a single node kafka instance. I now want to deploy this to a truly distributed cluster with multiple kafka brokers. Do the connector files have to be copied to all the broker nodes under the kafka connect directory? How is debezium installed to a mult-node cluster,

Gunnar Morling

unread,

May 21, 2021, 1:11:21 PM5/21/21

to debezium

Kafka Connect is a separate runtime and process, and while being part of the Kafka distribution, I would not recommend to run it on Kafka broker nodes themselves, but on separate machines. It supports its own clustering ("distributed mode"), i.e. you have two clusters: one with Kafka itself, and one for Kafka Connect.

Hth,

--Gunnar

Krishnanand Khambadkone

unread,

May 30, 2021, 9:30:30 PM5/30/21

to debezium

Thank you so much for the response

Reply all

Reply to author

Forward