How to use debezium when 'allow.auto.create.topics' is set to false.

[V主宰]

Debezium version : 1.5

1、Kafka's property 'allow.auto.create.topics' is set to false by admin, in this case how should i to config debezium, support or not?

2、I found that debezium's consumer property 'allow.auto.create.topics' is true default(see as follow), how can i change it to false? 

2021-08-17 20:50:51,946 INFO   ||  ConsumerConfig values: 

        allow.auto.create.topics = true

        auto.commit.interval.ms = 5000

        auto.offset.reset = earliest

        bootstrap.servers = [10.21.8.36:9092, 10.21.8.37:9092, 10.21.17.95:9092]

        check.crcs = true

        client.dns.lookup = use_all_dns_ips

        client.id = consumer-debezium_test-1

        client.rack = 

        connections.max.idle.ms = 540000

        default.api.timeout.ms = 60000

        enable.auto.commit = false

        exclude.internal.topics = true

        fetch.max.bytes = 52428800

        fetch.max.wait.ms = 500

        fetch.min.bytes = 1

        group.id = debezium_test

        group.instance.id = null

        heartbeat.interval.ms = 3000

        interceptor.classes = []

        internal.leave.group.on.close = true

        internal.throw.on.fetch.stable.offset.unsupported = false

        isolation.level = read_uncommitted

        key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer

        max.partition.fetch.bytes = 1048576

        max.poll.interval.ms = 300000

        max.poll.records = 500

        metadata.max.age.ms = 300000

        metric.reporters = []

        metrics.num.samples = 2

        metrics.recording.level = INFO

        metrics.sample.window.ms = 30000

        partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]

        receive.buffer.bytes = 65536

        reconnect.backoff.max.ms = 1000

        reconnect.backoff.ms = 50

        request.timeout.ms = 30000

        retry.backoff.ms = 100

        sasl.client.callback.handler.class = null

        sasl.jaas.config = null

        sasl.kerberos.kinit.cmd = /usr/bin/kinit

        sasl.kerberos.min.time.before.relogin = 60000

        sasl.kerberos.service.name = null

        sasl.kerberos.ticket.renew.jitter = 0.05

        sasl.kerberos.ticket.renew.window.factor = 0.8

[Gunnar Morling]

Hi,

Which connector is this about? In particular, is it one using a DB history topic (I assume that yes).

If you are on Kafka Connect 2.6 or newer, I recommend you let Kafka Connect create any topics (see https://debezium.io/documentation/reference/configuration/topic-auto-create-config.html); note this is independent from auto topic creation in the broker itself. If the connector uses a history topic, you'd have to create that one in addition by yourself. If you are on Kafka Connect older than 2.6, you'd have to create all the topics by yourself.

Hth,

--Gunnar