Debezium JDBC sink connector in AWS MSK connect to Postgres

[Ramesh Venkitaswaran]

I have successfully setup a AWS MSK source connector from Oracle to Kafka - Now I'm trying to setup a sink connector version 3.7.x from Kafka to Postgres (RDS in AWS). I am using Debezium JDBC sink connector version 3.1.1.Final. 

When the connector starts up, it throws this error in the logs. I've searched this forum as well as other google searches and I have been unsuccessful. Any help or pointers on where I would go next would be appreciated.

[Worker-0c8c13d7874217845] [2025-06-04 21:31:17,472] ERROR [msk-sink-pg-chubq-01|task-0] WorkerSinkTask{id=msk-sink-pg-chubq-01-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:212)
[Worker-0c8c13d7874217845] java.lang.NoClassDefFoundError: Could not initialize class org.hibernate.type.format.jackson.JacksonIntegration
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.SessionFactoryOptionsBuilder.lambda$determineJsonFormatMapper$6(SessionFactoryOptionsBuilder.java:803)
[Worker-0c8c13d7874217845] at org.hibernate.boot.registry.selector.internal.StrategySelectorImpl.resolveStrategy(StrategySelectorImpl.java:220)
[Worker-0c8c13d7874217845] at org.hibernate.boot.registry.selector.internal.StrategySelectorImpl.resolveDefaultableStrategy(StrategySelectorImpl.java:180)
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.SessionFactoryOptionsBuilder.determineJsonFormatMapper(SessionFactoryOptionsBuilder.java:799)
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.SessionFactoryOptionsBuilder.<init>(SessionFactoryOptionsBuilder.java:305)
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.SessionFactoryBuilderImpl.<init>(SessionFactoryBuilderImpl.java:49)
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.DefaultSessionFactoryBuilderService.createSessionFactoryBuilder(DefaultSessionFactoryBuilderService.java:26)
[Worker-0c8c13d7874217845] at org.hibernate.boot.internal.MetadataImpl.getSessionFactoryBuilder(MetadataImpl.java:170)
[Worker-0c8c13d7874217845] at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:911)
[Worker-0c8c13d7874217845] at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:960)
[Worker-0c8c13d7874217845] at io.debezium.connector.jdbc.JdbcSinkConnectorTask.start(JdbcSinkConnectorTask.java:100)
[Worker-0c8c13d7874217845] at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:329)
[Worker-0c8c13d7874217845] at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:202)
[Worker-0c8c13d7874217845] at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:259)
[Worker-0c8c13d7874217845] at org.apache.kafka.connect.runtime.isolation.Plugins.lambda$withClassLoader$1(Plugins.java:237)
[Worker-0c8c13d7874217845] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
[Worker-0c8c13d7874217845] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[Worker-0c8c13d7874217845] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
[Worker-0c8c13d7874217845] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[Worker-0c8c13d7874217845] at java.base/java.lang.Thread.run(Thread.java:840)
[Worker-0c8c13d7874217845] Caused by: java.lang.ExceptionInInitializerError: Exception com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.16.0 requires Jackson Databind version >= 2.16.0 and < 2.17.0 - Found jackson-databind version 2.12.7-1 [in thread "task-thread-msk-sink-pg-chubq-01-0"]
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.module.scala.JacksonModule.setupModule(JacksonModule.scala:61)
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.module.scala.JacksonModule.setupModule$(JacksonModule.scala:46)
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:21)
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:835)
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.databind.ObjectMapper.registerModules(ObjectMapper.java:1037)
[Worker-0c8c13d7874217845] at com.fasterxml.jackson.databind.ObjectMapper.findAndRegisterModules(ObjectMapper.java:1115)
[Worker-0c8c13d7874217845] at org.hibernate.type.format.jackson.JacksonJsonFormatMapper.<init>(JacksonJsonFormatMapper.java:26)
[Worker-0c8c13d7874217845] at org.hibernate.type.format.jackson.JacksonIntegration.<clinit>(JacksonIntegration.java:18)
[Worker-0c8c13d7874217845] ... 20 more

[jiri.p...@gmail.com]

Hi,

there must be something wrong on your classpath. I just checked that JDBC connector (3.1.1) does not ship with Jackson and uses the one from Connect which in Kafka 3.7 is 2.16.2.

Jiri

[Chris Cranford]

Hi -

Your Kafka Connect `/lib` directory has an older Jackson version on the global class path than what Hibernate is compatible with. Please see this thread [1] on Zulip for the list of jars you need to install into the Debezium JDBC sink directory so that you can provide the correct versions needed by Hibernate for the sink connector to properly start.

Thanks,
-cc

[1]: #community-jdbc > error creating jdbc sink connector @ 💬

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/c8dd426e-9723-41cd-a331-9b7d9d658178n%40googlegroups.com.

[Ramesh Venkitaswaran]

Thank you for your help! I was able to get past the error by adding the following jars. I have a different error now :) but I'll work on it before asking for help.

jackson-core-2.16.1.jar
jackson-databind-2.16.1.jar
jackson-datatype-jdk8-2.16.1.jar
jackson-module-afterburner-2.16.1.jar
jackson-module-jaxb-annotations-2.16.1.jar
jackson-module-scala_2.13-2.16.1.jar