Can I run CP 3.0 with kafka 0.9?

[PP]

I've tried and got this error:

ERROR Uncaught exception in herder work thread, exiting:  (org.apache.kafka.connect.runtime.distributed.DistributedHerder:183)

org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'topic_metadata': Error reading array of size 548723, only 36 bytes available

at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)

at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)

at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)

at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)

at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)

at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)

at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:178)

at org.apache.kafka.clients.consumer.internals.Fetcher.getTopicMetadata(Fetcher.java:205)

at org.apache.kafka.clients.consumer.KafkaConsumer.partitionsFor(KafkaConsumer.java:1272)

at org.apache.kafka.connect.util.KafkaBasedLog.start(KafkaBasedLog.java:131)

at org.apache.kafka.connect.storage.KafkaOffsetBackingStore.start(KafkaOffsetBackingStore.java:86)

at org.apache.kafka.connect.runtime.Worker.start(Worker.java:121)

at org.apache.kafka.connect.runtime.AbstractHerder.startServices(AbstractHerder.java:105)

at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:171)

at java.lang.Thread.run(Thread.java:745)

[gerard...@dizzit.com]

We are running CP 3.0 woth 0.9 brokers for a few days and ran some tests, so far no errors. Do you had CP 2.0 running correctly before?

[PP]

Yes.  We've been running 2.0.1 with Kafka 0.9.

[Ewen Cheslack-Postava]

CP 3.0 uses Kafka 0.10.0.0 clients and builds against 0.10.0.0 APIs (e.g. for Connectors), so in general you'll need to get your brokers updated first, then switch to CP 3.0 services. There may be some cases that *happen* to work ok because they don't encounter any new request versions or APIs, but it is not guaranteed.

-Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/753cb3c9-c8df-4677-812a-4b8ef0ef1dfe%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen