Class io.confluent.connect.avro.AvroConverter could not be found

[Ehasnul Khan]

Hello,

While trying to run Debezium Oracle connector (connect-distributed ~/project/ek/kafka-debezium-oracle-prototype/kafka-connect/connect-distributed.properties) , I am running into issue when I run Debezium connector. Please advise!

[2019-04-15 23:24:04,345] ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectDistributed:117)

org.apache.kafka.common.config.ConfigException: Invalid value io.confluent.connect.avro.AvroConverter for configuration key.converter: Class io.confluent.connect.avro.AvroConverter could not be found.

    at org.apache.kafka.common.config.ConfigDef.parseType(ConfigDef.java:718)

     at org.apac

 

Setup:

 

 Workder Config:

bootstrap.servers=localhost:9092

group.id=1

key.converter=io.confluent.connect.avro.AvroConverter
key.converter.schema.registry.url=http://localhost:8081

value.converter=io.confluent.connect.avro.AvroConverter
value.converter.schema.registry.url=http://localhost:8081

internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter

#key.converter=org.apache.kafka.connect.json.JsonConverter
#value.converter=org.apache.kafka.connect.json.JsonConverter



offset.storage.topic=connect_offsets
offset.storage.replication.factor=1
offset.storage.partitions=1

config.storage.topic=connect_configs
config.storage.replication.factor=1

status.storage.topic=connect_status
status.storage.replication.factor=1
status.storage.partitions=1

offset.flush.interval.ms=10000

plugin.path=connectors

 

POM.xml

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>com.get2stream.prototype</groupId>
    <artifactId>kafka-debezium-oracle-prototype</artifactId>
    <version>1.0</version>


    <dependencies>

        <!-- https://mvnrepository.com/artifact/io.debezium/debezium-connector-oracle -->
        <dependency>
            <groupId>io.debezium</groupId>
            <artifactId>debezium-connector-oracle</artifactId>
            <version>0.9.0.Alpha1</version>
        </dependency>





    </dependencies>


</project>

[Jiri Pechanec]

Hi,

do you use Debezium's or Confluent's Docker image? If not then you need to manually install Avro converter to your Kafka Connect distribution.

J.

[Ehsanul khan]

Hi Jiri- I use none. My environment is on my mac machine.

I will lookup to see how to install avro converter.

Thanks!

Ehsan

Sent from my iPhone

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To post to this group, send email to debe...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/aeda0007-99fd-43b6-a305-fd2783c59270%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jiri Pechanec]

Hi,

the Avro converter setup can be found here

 - https://debezium.io/docs/faq/#avro-converter

 - https://debezium.io/docs/configuration/avro/

The list of JARs we are adding to the image to enable avro is in https://github.com/debezium/docker-images/blob/master/connect-base/0.9/Dockerfile#L32

J.

On Tuesday, April 16, 2019 at 8:37:27 AM UTC+2, Ehasnul Khan wrote:

[Ehasnul Khan]

Hi Jiri,

Please see my jar files below. I believe I have the Avro files. Can you please let me know if I am missing something. Also do I need to update my POM.xml file?

Thanks!! -Ehsan

To unsubscribe from this group and stop receiving emails from it, send an email to debezium+unsubscribe@googlegroups.com.

[Jiri Pechanec]

Hi,

IMHO the Avro realted libs should be in Kafka lib directory not in connector directory.

J.

To unsubscribe from this group and stop receiving emails from it, send an email to debe...@googlegroups.com.

[Ehasnul Khan]

Thanks, Jiri!