Error in HDFS connector with Avro

[Saeed Shariati]

Dear All!

Thanks for your great stuffs in Confluent!

I'm trying to use HDFS connector over HIVE and write in Single mode. According to your example I'm using the below command:

"connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-connect-hdfs/quickstart-hdfs.properties"

Here is what I get in return:

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/usr/share/java/confluent-common/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/share/java/kafka-serde-tools/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/share/java/kafka-connect-hdfs/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/usr/share/java/kafka/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

[2016-02-29 17:04:59,775] INFO StandaloneConfig values: 

cluster = connect

rest.advertised.host.name = null

task.shutdown.graceful.timeout.ms = 5000

rest.host.name = null

rest.advertised.port = null

bootstrap.servers = [localhost:9092]

offset.flush.timeout.ms = 5000

offset.flush.interval.ms = 60000

rest.port = 8083

internal.key.converter = class org.apache.kafka.connect.json.JsonConverter

internal.value.converter = class org.apache.kafka.connect.json.JsonConverter

value.converter = class io.confluent.connect.avro.AvroConverter

key.converter = class io.confluent.connect.avro.AvroConverter

 (org.apache.kafka.connect.runtime.standalone.StandaloneConfig:165)

Exception in thread "main" java.lang.IncompatibleClassChangeError: Implementing class

at java.lang.ClassLoader.defineClass1(Native Method)

at java.lang.ClassLoader.defineClass(ClassLoader.java:760)

at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)

at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)

at java.net.URLClassLoader.access$100(URLClassLoader.java:73)

at java.net.URLClassLoader$1.run(URLClassLoader.java:368)

at java.net.URLClassLoader$1.run(URLClassLoader.java:362)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:361)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

at java.lang.ClassLoader.defineClass1(Native Method)

at java.lang.ClassLoader.defineClass(ClassLoader.java:760)

at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)

at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)

at java.net.URLClassLoader.access$100(URLClassLoader.java:73)

at java.net.URLClassLoader$1.run(URLClassLoader.java:368)

at java.net.URLClassLoader$1.run(URLClassLoader.java:362)

...

I've tried to google the issue and had no success. I highly appreciate if you could guide me!

Cheers,

Saeed

[iman teimoornegad]

hi sir
just remove duplicated version of jar files and replace them with latest and stable version

[Saeed Shariati]

Thanks Iman!

It wasn't for log4j. But thanks to your advice, I managed to get rid of this error by unsetting CLASSPATH.

I assume it had some classes which messing up with Connector.

Cheers,

Saeed