maven dependency settings to use KafkaAvroSerializer

5,200 views
Skip to first unread message

CL

unread,
Oct 8, 2015, 5:31:47 PM10/8/15
to Confluent Platform
Trying to replace our interim home-grown SerDe class with
 io.confluent.kafka.serializers.KafkaAvroSerializer
in our application code, in order to take advantage of Confluent Platform's Schema Registry

But having trouble with the correct entries in pom.xml; dependency for kafka-avro-serializer is not found.
Tried following but getting error.

...
    <repositories>
        <repository>
            <id>confluent</id>
            <url>http://packages.confluent.io/maven/</url>
        </repository>
    </repositories>
...
    <properties>
        ...
        <kafka.version>0.8.2.0</kafka.version>
        <kafka-avro-serializer.version>2.0-SNAPSHOT</kafka-avro-serializer.version>
        ...
    </properties>

        <dependency>
            <groupId>org.apache.kafka</groupId>
            <artifactId>kafka-clients</artifactId>
            <version>${kafka.version}</version>
            <exclusions>
                ...
            </exclusions>
        </dependency>
        <dependency>
            <groupId>io.confluent</groupId>
            <artifactId>kafka-avro-serializer</artifactId>
            <version>${kafka-avro-serializer.version}</version>        <--- Dependency not found
        </dependency>

Ewen Cheslack-Postava

unread,
Oct 9, 2015, 1:05:29 AM10/9/15
to Confluent Platform
CL,

It looks like the versions you're trying to use aren't released versions that we have in our repository. For full details, you should refer to http://docs.confluent.io/1.0.1/installation.html#jars-via-maven-repository but the versions you want are 0.8.2.2 for kafka.version (the 1.0 release was 0.8.2.0-cp, but there was a recent update released) and 1.0.1 for kafka-avro-serializer.version. These will get you the jars from Confluent's latest release, 1.0.1.

We aren't currently publishing snapshot jars to the packages.confluent.io/maven repository. If you need 2.0-SNAPSHOT builds, you would need to build them from the master branch of our repositories.

-Ewen


--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/f7db6622-7dd9-40fb-88e8-b330694891a4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Thanks,
Ewen

CL

unread,
Oct 9, 2015, 4:18:45 PM10/9/15
to Confluent Platform
Thanks, Ewen. Was able to do a successful maven build for our internal project with the current version numbers/dependencies you suggested.

Just for the record in case it is helpful for others, the current Schema-Registry repo at https://github.com/confluentinc/schema-registry
now does build successfully with 'mvn package' with Java 1.7 (usage reference http://docs.confluent.io/1.0.1/schema-registry/docs/serializer-formatter.html),
unlike a couple of weeks ago when it failed and I had to do a few extra steps.

-CL
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.



--
Thanks,
Ewen
Message has been deleted

Ewen Cheslack-Postava

unread,
Feb 3, 2017, 12:07:01 AM2/3/17
to Confluent Platform
Sushil,

I've followed up on one of the other issues you filed.

-Ewen

On Wed, Feb 1, 2017 at 11:48 AM, Sushil Dodake <sushil...@gmail.com> wrote:
Ewen,

This may not be the correct thread but i am trying to figure out how do i resolve my problem which is similar to this. 
here is a link for it.


any help will be greatly appreciated.

Thanks,

Sushil


On Friday, October 9, 2015 at 1:05:29 AM UTC-4, Ewen Cheslack-Postava wrote:
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.



--
Thanks,
Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/f0781b71-dfba-416d-844c-3c2e4f7f3724%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages