MSK-Debezium-MySQL connector - stops streaming after 32+ hours - no errors

[Balaji Yuvarajan]

Hello all,

I have been facing this issue for while and unable to find a resolution. This is a summary of my scenario:

> MSK Cluster

> MSK Connector using this MSK Cluster

> Debezium connector to MySQL

The streaming works fine for about 32-38 hrs every time I restart the connector. But after the 38 hour window, the connector stops streaming. What makes it weird it, the MSK connector log looks just fine and logs messages normally, no error or warning. It appears there is some type of timeout setting, but I am just not able to find what the issue is, especially when there are no errors anywhere,

Any help in resolving this scenario is appreciated. Thanks.

[jiri.p...@gmail.com]

Hi,

could you please obtain a thread dump when this situation happens?

Jiri

[Balaji Yuvarajan]

Hi,

Which dump are you referring to? Form the Cloudwatch logs, I see no errors. The MySQL "Binlog" process is just stuck after about 30-40 hours.

Then when I update or restart the connector it works for next 40 hrs.

[jiri.p...@gmail.com]

I am talking about the thread dump of Kafka Connect process running the Debezium connector. I am ot sure if it is something you'd be able to obtaine yourself or whther you need a cooperation of AWS support to obtain it.

Jiri