Oracle GG Confluent Kafka Adapter

[Björn Ahl]

Is it possible to configure Confluent Kafka Adapter to use avro format ?

I tried to configure - confluent.properties

value.converter=io.confluent.connect.avro.AvroConverter

key.converter=io.confluent.connect.avro.AvroConverter

Then i get Kafka message in Avro. But then the Golden Gate Replicat Process to abend when i do schema changs (Add Column to the table)

Error msg

2016-11-08 14:22:19  ERROR   OGG-15051  Oracle GoldenGate Delivery, ckafka.prm:  Java or JNI exception:
org.apache.kafka.connect.errors.DataException: Failed to serialize Avro data:.
2016-11-08 14:22:19  ERROR   OGG-01668  Oracle GoldenGate Delivery, ckafka.prm:  PROCESS ABENDING.

I guess i have to configure value.serializer & key.serializer

[Ewen Cheslack-Postava]

Bjorn,

Have you specified the schema.registry.url somewhere in your config? You are probably using the AvroConverter but then it may fail to contact the schema registry if you haven't specified the right URL.

-Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/413bafe5-93ef-4b6a-8ffa-346557b9bdd9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[da...@confluent.io]

Please add the URI specification to the Schema Registry for the converters.   By default, the Avro converter expects to leverage that service.   The property settings will be :

key.converter.schema.registry.url=http://localhost:8081

value.converter.schema.registry.url=http://localhost:8081 

(obviously, you'll include your deployment's Schema Registry location).

Alternatively, you could disable Schema's altogether by setting the [key|value].converter.schemas.enable flags to false, but that's not the model we recommend for Connectors.

-- David

[Robin Moffatt]

Just to follow this up for any future Google-hits -- if you have trailing whitespace in the url (as you'll get from copy & pasting the example here, on the value url) then it won't work (same error - Failed to serialize Avro data). I found this out the hard way :) 

Blogged here for reference: http://rmoff.net/2016/11/29/oracle-goldengate-kafka-connect-failed-to-serialize-avro-data/

[Björn Ahl]

Thanks

Will test this when i got time. 

regards

Björn