Re: [debezium] Error during snapshot (io.debezium.relational.RelationalSnapshotChangeEventSource:179)

383 views
Skip to first unread message

Chris Cranford

unread,
Mar 20, 2024, 7:59:55 AM3/20/24
to debe...@googlegroups.com
Hi Viss -

Without the actual error, we can only speculate but what I would first check is whether or not the user you're connecting to MySQL with can execute "SHOW MASTER STATUS".  Given the placement of the "Read binlog position" and then the error, this may be that the user is unable to resolve binlog position details due to some missing permission or grant.

Thanks,
Chris

On 3/19/24 15:25, Viss wrote:
Hello everyone,

I started a connection with MySQL and Kafka with debezium connector via confluent (on wsl). Although its running no messages are printed on consumer. On connection logs there is an error during snapshot but idk how to solve it.

Here are the connection logs:

[2024-03-19 21:02:21,704] INFO [movielens-connector|task-0] Read list of available tables in each database (io.debezium.connector.mysql.MySqlSnapshotChangeEventSource:145)
[2024-03-19 21:02:21,710] INFO [movielens-connector|task-0]     snapshot continuing with database(s): [mov] (io.debezium.connector.mysql.MySqlSnapshotChangeEventSource:166)
[2024-03-19 21:02:21,710] INFO [movielens-connector|task-0] Adding table mov.movs to the list of capture schema tables (io.debezium.relational.RelationalSnapshotChangeEventSource:289)
[2024-03-19 21:02:21,711] INFO [movielens-connector|task-0] Created connection pool with 1 threads (io.debezium.relational.RelationalSnapshotChangeEventSource:222)
[2024-03-19 21:02:21,711] INFO [movielens-connector|task-0] Snapshot step 3 - Locking captured tables [mov.movs] (io.debezium.relational.RelationalSnapshotChangeEventSource:139)
[2024-03-19 21:02:21,711] INFO [movielens-connector|task-0] Flush and obtain global read lock to prevent writes to database (io.debezium.connector.mysql.MySqlSnapshotChangeEventSource:519)
[2024-03-19 21:02:21,712] INFO [movielens-connector|task-0] Snapshot step 4 - Determining snapshot offset (io.debezium.relational.RelationalSnapshotChangeEventSource:145)
[2024-03-19 21:02:21,712] INFO [movielens-connector|task-0] Read binlog position of MySQL primary server (io.debezium.connector.mysql.MySqlSnapshotChangeEventSource:293)
[2024-03-19 21:02:21,713] ERROR [movielens-connector|task-0] Error during snapshot (io.debezium.relational.RelationalSnapshotChangeEventSource:179)
[2024-03-19 21:02:21,713] INFO [movielens-connector|task-0] Snapshot - Final stage (io.debezium.pipeline.source.AbstractSnapshotChangeEventSource:104)
[2024-03-19 21:02:21,713] WARN [movielens-connector|task-0] Snapshot was not completed successfully, it will be re-executed upon connector restart (io.debezium.pipeline.source.AbstractSnapshotChangeEventSource:115)
[2024-03-19 21:02:21,713] ERROR [movielens-connector|task-0] Producer failure (io.debezium.pipeline.ErrorHandler:52)
[2024-03-19 21:02:21,714] WARN [movielens-connector|task-0] Retry 2 of unlimited retries will be attempted (io.debezium.pipeline.ErrorHandler:125)
[2024-03-19 21:02:22,203] WARN [movielens-connector|task-0] Going to restart connector after 10 sec. after a retriable exception (io.debezium.connector.common.BaseSourceTask:281)
[2024-03-19 21:02:22,204] INFO [movielens-connector|task-0] SignalProcessor stopped (io.debezium.pipeline.signal.SignalProcessor:127)
[2024-03-19 21:02:22,206] INFO [movielens-connector|task-0] Connection gracefully closed (io.debezium.jdbc.JdbcConnection:947)
[2024-03-19 21:02:22,206] INFO [movielens-connector|task-0] [Producer clientId=movielens-schemahistory] Closing the Kafka producer with timeoutMillis = 30000 ms. (org.apache.kafka.clients.producer.KafkaProducer:1298) 

Can anyone help me?
--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/0f6869bd-1e7d-46e7-b9e5-7e2a3d31680cn%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages