Kafka Connect disable initial default topic creation

[Francis Siefken]

Good morning,

How can Kafka Connect be prevented to create the default connect topics (config, offset and status) when they do not exist?
There is the broker  auto.create.topic.enable (set to false) setting, but they get created regardless.
Is there a connect config option to prevent this?

From the documentation:
==
Earlier versions of Kafka Connect required you to manually create these topics, but now Kafka Connect can do this automatically when it starts up. You can control the names, replication factor, and number of partitions for these topics in the Kafka Connect distributed worker configuration, and all topics are created with compaction cleanup policy.

You may still want to manually create these Kafka topics before starting Kafka Connect if, for example, your broker may be configured to not allow clients such as Kafka Connect to create topics, or you require other advanced topic-specific settings that are not set by Kafka Connect and that are different than the broker’s auto-created topic settings.
===

Kind regards,
Francis

[Randall Hauch]

Connect distributed mode cannot work without these topics, so there's no way to tell Connect not to create these topics if they don't already exist when the Connect worker runs. As of AK 1.0, Connect uses Kafka's admin API to create the topics (if the broker is new enough to have those APIs), and only relies upon broker-side auto-creation if the broker is older and doesn't have the admin APIs.

Best regards,

Randall

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/b681a495-980d-4090-bc5c-9b11e8e73a42%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.