Replicator quickstart

385 views
Skip to first unread message

arodr...@stratio.com

unread,
Jan 20, 2017, 6:55:06 AM1/20/17
to Confluent Platform
Hi all,

I've been following the steps from the connect-replicator quickstart guide and having some problems on starting the connector. The ReplicatorSourceConnector code is not included within the confluent 3.1.1 platform tar that I've downloaded so when I execute:

./bin/connect-standalone ./etc/schema-registry/connect-avro-standalone.properties ./etc/kafka-connect-replicator/quickstart-replicator.properties

The connector can not find the ReplicatorSourceConnector class:

[2017-01-20 12:48:21,449] ERROR Failed to start connector test-replicator (org.apache.kafka.connect.runtime.Worker:166)
org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.replicator.ReplicatorSourceConnector, available connectors are: org.apache.kafka.connect.file.FileStreamSinkConnector, org.apache.kafka.connect.sink.SinkConnector, org.apache.kafka.connect.tools.SchemaSourceConnector, org.apache.kafka.connect.tools.MockSinkConnector, io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, io.confluent.connect.jdbc.JdbcSourceConnector, io.confluent.connect.jdbc.JdbcSinkConnector, io.confluent.connect.hdfs.HdfsSinkConnector, org.apache.kafka.connect.file.FileStreamSourceConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.tools.VerifiableSourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, io.confluent.connect.hdfs.tools.SchemaSourceConnector, org.apache.kafka.connect.source.SourceConnector, org.apache.kafka.connect.tools.MockConnector

Has anyone gone through the tutorial? I'd like to start this stuff this way instead of using the docker compose option explained in the cp-docker-images repo: tutorials replicator

Dustin Cote

unread,
Jan 20, 2017, 7:44:32 AM1/20/17
to confluent...@googlegroups.com
I just verified the 3.1.1 download of Confluent Enterprise includes Replicator within it. Did you download the Enterprise tar file? Replicator is not included in the open source version.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/ca1eebd5-887f-48ed-bbf2-1c12e36e4fa9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Dustin Cote
Customer Operations Engineer | Confluent
Follow us: Twitter | blog

arodr...@stratio.com

unread,
Jan 20, 2017, 8:54:46 AM1/20/17
to Confluent Platform
Thank you for replying Dustin! 

I downloaded the open source version, will try the Enterprise instead, thank you very much!


El viernes, 20 de enero de 2017, 13:44:32 (UTC+1), Dustin Cote escribió:
I just verified the 3.1.1 download of Confluent Enterprise includes Replicator within it. Did you download the Enterprise tar file? Replicator is not included in the open source version.
On Fri, Jan 20, 2017 at 6:55 AM, <arodr...@stratio.com> wrote:
Hi all,

I've been following the steps from the connect-replicator quickstart guide and having some problems on starting the connector. The ReplicatorSourceConnector code is not included within the confluent 3.1.1 platform tar that I've downloaded so when I execute:

./bin/connect-standalone ./etc/schema-registry/connect-avro-standalone.properties ./etc/kafka-connect-replicator/quickstart-replicator.properties

The connector can not find the ReplicatorSourceConnector class:

[2017-01-20 12:48:21,449] ERROR Failed to start connector test-replicator (org.apache.kafka.connect.runtime.Worker:166)
org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.replicator.ReplicatorSourceConnector, available connectors are: org.apache.kafka.connect.file.FileStreamSinkConnector, org.apache.kafka.connect.sink.SinkConnector, org.apache.kafka.connect.tools.SchemaSourceConnector, org.apache.kafka.connect.tools.MockSinkConnector, io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, io.confluent.connect.jdbc.JdbcSourceConnector, io.confluent.connect.jdbc.JdbcSinkConnector, io.confluent.connect.hdfs.HdfsSinkConnector, org.apache.kafka.connect.file.FileStreamSourceConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.tools.VerifiableSourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, io.confluent.connect.hdfs.tools.SchemaSourceConnector, org.apache.kafka.connect.source.SourceConnector, org.apache.kafka.connect.tools.MockConnector

Has anyone gone through the tutorial? I'd like to start this stuff this way instead of using the docker compose option explained in the cp-docker-images repo: tutorials replicator

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Saravanan Tirugnanum

unread,
Jan 20, 2017, 3:22:05 PM1/20/17
to Confluent Platform
is Connect Replicator Compatible with older brokers ( kafka 0.8 or 0.9 )

Regards
Saravanan

ha...@confluent.io

unread,
Jan 21, 2017, 3:33:51 PM1/21/17
to Confluent Platform
No. Replicator has a newer Kafka client and as of today, newer java clients cannot talk to older Kafka brokers.

Ewen Cheslack-Postava

unread,
Jan 31, 2017, 12:50:52 AM1/31/17
to Confluent Platform
Note that with future releases the compatibility story will get a bit simpler (you'll be able to use newer clients with older brokers as long as those clients don't need any functionality only provided by newer brokers). However, since the compatibility support wasn't included until 0.10 versions of Kafka, this more flexible compatibility will be restricted to 0.10+ brokers and 0.10.2.0+ clients.

-Ewen

On Sat, Jan 21, 2017 at 12:33 PM, <ha...@confluent.io> wrote:
No. Replicator has a newer Kafka client and as of today, newer java clients cannot talk to older Kafka brokers.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/4f62f68f-607b-4851-b7c5-742af56afe53%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages