[debezium] Problems when connecting more than one connector

[Sooya Park]

hello.

I am using the debezium connector to connect to MySQL.

There is one physical instance and multiple logical DBs.

I want to connect one logical DB per connector.

One connector is connected properly and is being used normally.

Then, if you try to connect another connector to another logical DB, the following error occurs.

io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to SCHEMA_ONLY_RECOVERY

Depending on the error, if you change snapshot_mode to SCHEMA_ONLY_RECOVERY and rerun, the following error occurs.

The connector is trying to read binlog starting at SourceInfo.......but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed.

If the connector settings are the same, only the database.include.list and database.server.id are used differently.

It seems that schema.history.internal.kafka.topic is the problem, so even if I change the connector that is running normally and the new connector, the same error occurs.

Even if you delete and recreate the connector you are trying to connect to, the problem is the same.

Thank you for your help.

What setting is the problem?

thank you

[Chris Cranford]

Hi -

You cannot share the schema history topic (or schema history file) across connectors or topic.prefix.  Additionally for MySQL, each connector deployment should be assigned a unique database.server.id.  Please make sure that these values are unique for each connector or you will experience unexpected behavior.

Thanks,
Chris

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/CAEL_Joz%3DXM%3DdL%3DMC_sOhyhs3%3DSMZ2nOEb5Gr1-ABi_3%3DfzOmdA%40mail.gmail.com.

[Sooya Park]

hello

I have confirmed the information you sent.

I have something additional to ask.

Currently, the mysql debezium connector is operated with snapshot_mode set to when_needed, "database.include.list": "AAAA", "table.include.list": "AAAA.test1".

At this time, we are trying to additionally CDC a table called test2 in AAAA DB. At this time, even if we change the value of "table.include.list" to "table.include.list": "AAAA.test1, AAAA.test2", the test2 table is added. CDC is not working... I would like to inquire what I need to do to CDC additional tables like this.

Thanks for your help.

[Chris Cranford]

Hi -

When you say that CDC is not working, what error message and stack trace are you seeing?

Thanks,
CC

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/CAEL_JoxajoqQSCug8HYLY%3Dj%3DhxL3r9aYrd5tysYLtDr8K32ngw%40mail.gmail.com.