debezium-connector-postgres and confluent-4.0.0 can not load plugin
1,515 views
Skip to first unread message
igue...@rocketlawyer.com
Apr 6, 2018, 1:51:52 AM4/6/18
to debezium
Hi all,
I'm trying to configure/use debezium
after launching connect I can see that debezium plugin were loaded and registered
[2018-04-05 23:09:48,589] INFO Loading plugin from: /home/iguenkin/debezium-connector-postgres/postgresql-42.0.0.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
[2018-04-05 23:09:48,655] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium-connector-postgres/postgresql-42.0.0.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
[2018-04-05 23:09:48,661] INFO Loading plugin from: /home/iguenkin/debezium-connector-postgres/protobuf-java-2.6.1.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
[2018-04-05 23:09:48,702] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium-connector-postgres/protobuf-java-2.6.1.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
[2018-04-05 23:09:48,703] INFO Loading plugin from: /home/iguenkin/debezium-connector-postgres/debezium-core-0.7.5.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
[2018-04-05 23:09:48,749] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium-connector-postgres/debezium-core-0.7.5.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
[2018-04-05 23:09:48,749] INFO Loading plugin from: /home/iguenkin/debezium-connector-postgres/debezium-connector-postgres-0.7.5.jar (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
[2018-04-05 23:09:48,763] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium-connector-postgres/debezium-connector-postgres-0.7.5.jar} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
also the list of loaded properties indicates that connector were visible for connect process
[2018-04-05 23:09:54,957] INFO DistributedConfig values:
access.control.allow.methods =
access.control.allow.origin =
bootstrap.servers = [localhost:9092]
client.id =
config.storage.replication.factor = 1
config.storage.topic = connect-configs
connections.max.idle.ms = 540000
group.id = connect-cluster
heartbeat.interval.ms = 3000
internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
key.converter = class io.confluent.connect.avro.AvroConverter
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
offset.flush.interval.ms = 60000
offset.flush.timeout.ms = 5000
offset.storage.partitions = 25
offset.storage.replication.factor = 1
offset.storage.topic = connect-offsets
plugin.path = [/home/iguenkin/confluent-4.0.0/share/java, /home/iguenkin/debezium-connector-postgres]
rebalance.timeout.ms = 60000
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 40000
rest.advertised.host.name = localhost
rest.advertised.port = 8083
rest.host.name = localhost
rest.port = 8083
retry.backoff.ms = 100however when I'm running confluent list plugins it does not show debezium plugin
iguenkin@rllasinfradb001:/tmp/confluent.Ji0a83fS/connect$ confluent list plugins
Available Connector Plugins:
[
{
"class":"io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
"type":"sink",
"version":"4.0.0"
},
{
"class":"io.confluent.connect.hdfs.HdfsSinkConnector",
"type":"sink",
"version":"4.0.0"
},
{
"class":"io.confluent.connect.hdfs.tools.SchemaSourceConnector",
"type":"source",
"version":"1.0.0-cp1"
},
{
"class":"io.confluent.connect.jdbc.JdbcSinkConnector",
"type":"sink",
"version":"4.0.0"
},
{
"class":"io.confluent.connect.jdbc.JdbcSourceConnector",
"type":"source",
"version":"4.0.0"
},
{
"class":"io.confluent.connect.s3.S3SinkConnector",
"type":"sink",
"version":"4.0.0"
},
{
"class":"io.confluent.connect.storage.tools.SchemaSourceConnector",
"type":"source",
"version":"1.0.0-cp1"
},
{
"class":"org.apache.kafka.connect.file.FileStreamSinkConnector",
"type":"sink",
"version":"1.0.0-cp1"
},
{
"class":"org.apache.kafka.connect.file.FileStreamSourceConnector",
"type":"source",
"version":"1.0.0-cp1"
}
]so, nothing surprising when confluent load failed
confluent load dbz-test -d ./tmp/kafka-connect-dibezium-source.json
Warning: Install 'jq' to add support for parsing JSON
{"error_code":500,"message":"Failed to find any class that implements Connector and which name matches io.debezium.connector.postgresql.PostgresConnector, available connectors are: PluginDesc{klass=class io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, name='io.confluent.connect.elasticsearch.ElasticsearchSinkConnector', version='4.0.0', encodedVersion=4.0.0, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-elasticsearch/'}, PluginDesc{klass=class io.confluent.connect.hdfs.HdfsSinkConnector, name='io.confluent.connect.hdfs.HdfsSinkConnector', version='4.0.0', encodedVersion=4.0.0, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-hdfs/'}, PluginDesc{klass=class io.confluent.connect.hdfs.tools.SchemaSourceConnector, name='io.confluent.connect.hdfs.tools.SchemaSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-hdfs/'}, PluginDesc{klass=class io.confluent.connect.jdbc.JdbcSinkConnector, name='io.confluent.connect.jdbc.JdbcSinkConnector', version='4.0.0', encodedVersion=4.0.0, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-jdbc/'}, PluginDesc{klass=class io.confluent.connect.jdbc.JdbcSourceConnector, name='io.confluent.connect.jdbc.JdbcSourceConnector', version='4.0.0', encodedVersion=4.0.0, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-jdbc/'}, PluginDesc{klass=class io.confluent.connect.s3.S3SinkConnector, name='io.confluent.connect.s3.S3SinkConnector', version='4.0.0', encodedVersion=4.0.0, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-s3/'}, PluginDesc{klass=class io.confluent.connect.storage.tools.SchemaSourceConnector, name='io.confluent.connect.storage.tools.SchemaSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-hdfs/'}, PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSinkConnector, name='org.apache.kafka.connect.file.FileStreamSinkConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSourceConnector, name='org.apache.kafka.connect.file.FileStreamSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockConnector, name='org.apache.kafka.connect.tools.MockConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=connector, typeName='connector', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSinkConnector, name='org.apache.kafka.connect.tools.MockSinkConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=sink, typeName='sink', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.MockSourceConnector, name='org.apache.kafka.connect.tools.MockSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.SchemaSourceConnector, name='org.apache.kafka.connect.tools.SchemaSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSinkConnector, name='org.apache.kafka.connect.tools.VerifiableSinkConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}, PluginDesc{klass=class org.apache.kafka.connect.tools.VerifiableSourceConnector, name='org.apache.kafka.connect.tools.VerifiableSourceConnector', version='1.0.0-cp1', encodedVersion=1.0.0-cp1, type=source, typeName='source', location='file:/home/iguenkin/confluent-4.0.0/share/java/kafka/'}"}
iguenkin@rllasinfradb001:~/confluent-4.0.0$Can someone point me to possible problem, I'm running out of ideas what I've done wrong
Jiri Pechanec
Apr 6, 2018, 2:52:01 AM4/6/18
to debezium
Hi,
what if you create this dir structure
/home/iguenkin/debezium/debezium-connector-postgres instead of /home/iguenkin/debezium-connector-postgres
what if you create this dir structure
/home/iguenkin/debezium/debezium-connector-postgres instead of /home/iguenkin/debezium-connector-postgres
and point plugin.path to/home/iguenkin/debezium?
J.
J.
igue...@rocketlawyer.com
Apr 6, 2018, 2:55:14 AM4/6/18
to debezium
thanks,
will try, but I do not see any difference
plugin.path should be able to load from any directory
igue...@rocketlawyer.com
Apr 6, 2018, 3:13:46 AM4/6/18
to debezium
Jiri,
what is different it is number of listed jars, in a log files, but it is recognized the location and connector ...
does not helped
[2018-04-06 07:02:38,498] INFO Loading plugin from: /home/iguenkin/debezium/debezium-connector-postgres (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
[2018-04-06 07:02:38,633] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium/debezium-connector-postgres/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)Jiri Pechanec
Apr 6, 2018, 3:25:38 AM4/6/18
to debezium
Can you please post the properties again? Or maybe even better the whole log file?
igue...@rocketlawyer.com
Apr 6, 2018, 3:32:23 AM4/6/18
to debezium
1 [2018-04-06 07:02:08,082] INFO Kafka Connect distributed worker initializing ... (org.apache.kafka.connect.cli.ConnectDistributed:60)
2 [2018-04-06 07:02:08,099] INFO WorkerInfo values:
3 jvm.args = -Xmx256M, -XX:+UseG1GC, -XX:MaxGCPauseMillis=20, -XX:InitiatingHeapOccupancyPercent=35, -XX:+ExplicitGCInvokesConcurrent, -Djava.awt.headless=true, -Dcom.sun.management.jmxremote, -Dcom.sun.management.jmxremote.authenticate=false, -Dcom.sun.management.jmxremote.ssl=false, -Dkafka.logs.dir=/home/iguenkin/confluent-4.0.0/bin/../logs, -Dlog4j.configuration=file:/home/iguenkin/confluent-4.0.0/bin/../etc/kafka/connect-log4j.properties
4 jvm.spec = Oracle Corporation, OpenJDK 64-Bit Server VM, 1.7.0_151, 24.151-b01
5 jvm.classpath = /home/iguenkin/confluent-4.0.0/share/java/kafka/slf4j-api-1.7.25.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-lang3-3.5.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/xz-1.5.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-continuation-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/connect-json-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-compress-1.8.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javax.inject-1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/metrics-core-2. 2.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-codec-1.9.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/zkclient-0.10.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka_2.11-1.0.0-cp1-javadoc.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/hk2-api-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/lz4-java-1.4.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-guava-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/aopalliance-repackaged-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/validation-api-1.1.0.Fina l.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/snappy-java-1.1.4.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-mapper-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javax.annotation-api-1.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/hk2-utils-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javax.inject-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-core-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-core-2.9.1.jar:/home/i guenkin/confluent-4.0.0/share/java/kafka/javassist-3.21.0-GA.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka-tools-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-jaxrs-base-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/rocksdbjni-5.7.3.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/connect-api-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javax.servlet-api-3.1.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/osgi-resource-locator-1.0.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-jaxrs-json-provider -2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-servlets-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/log4j-1.2.17.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-security-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jopt-simple-5.0.4.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/connect-file-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/httpmime-4.5.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-server-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-contai ner-servlet-core-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-common-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/plexus-utils-3.0.24.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka_2.11-1.0.0-cp1-sources.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-servlet-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-client-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka-log4j-appender-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka_2.11-1.0.0-cp1.jar:/home/iguenkin/confluent -4.0.0/share/java/kafka/commons-beanutils-1.8.3.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka-streams-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/httpcore-4.4.4.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/maven-artifact-3.5.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/guava-20.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/zookeeper-3.4.10.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javassist-3.20.0-GA.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/slf4j-log4j12-1.7.25.jar:/home/iguenkin/confluent-4.0.0/share/java/kaf ka/support-metrics-client-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-digester-1.8.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/argparse4j-0.7.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-module-jaxb-annotations-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-logging-1.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/hk2-locator-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-databind-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-util-9.2.22.v20170606.jar:/home/iguenkin/conf luent-4.0.0/share/java/kafka/jetty-http-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/support-metrics-common-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka-clients-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-container-servlet-2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/scala-library-2.11.11.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/avro-1.8.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka-streams-examples-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jersey-media-jaxb- 2.25.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jackson-annotations-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka_2.11-1.0.0-cp1-test.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-io-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/javax.ws.rs-api-2.0.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/reflections-0.9.11.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/connect-runtime-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/kafka_2.11-1.0.0-cp1-scaladoc.jar:/home/iguenkin/confluent-4.0.0/share/jav a/kafka/kafka_2.11-1.0.0-cp1-test-sources.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-collections-3.2.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/jetty-server-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-validator-1.4.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/paranamer-2.7.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/httpclient-4.5.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/connect-transforms-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka/commons-lang3-3.1.jar:/home/iguenkin/conflue nt-4.0.0/share/java/confluent-common/slf4j-api-1.7.25.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/netty-3.10.5.Final.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/zkclient-0.10.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/common-utils-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/common-metrics-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/log4j-1.2.17.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/build-tools-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/confluen t-common/jline-0.9.94.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/zookeeper-3.4.10.jar:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/common-config-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/xz-1.5.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/kafka-connect-avro-converter-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/commons-compress-1.8.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/jackson-mapper-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde- tools/jackson-core-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/jackson-core-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/kafka-schema-registry-client-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/kafka-avro-serializer-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/kafka-json-serializer-4.0.0.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/jackson-databind-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/snappy-java-1.1.1.3.jar:/home/iguenkin/conf luent-4.0.0/share/java/kafka-serde-tools/avro-1.8.2.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/jackson-annotations-2.9.1.jar:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/paranamer-2.7.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/slf4j-api-1.7.25.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-lang3-3.5.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/xz-1.5.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-continuation-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kaf ka/connect-json-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-compress-1.8.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javax.inject-1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/metrics-core-2.2.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-codec-1.9.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/zkclient-0.10.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1-javadoc.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/hk2-api-2.5.0-b32.jar:/home/iguen kin/confluent-4.0.0/bin/../share/java/kafka/lz4-java-1.4.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-guava-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/aopalliance-repackaged-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/validation-api-1.1.0.Final.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/snappy-java-1.1.4.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-mapper-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javax.annotation-api-1.2.jar:/home/iguenkin/confluent-4 .0.0/bin/../share/java/kafka/hk2-utils-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javax.inject-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-core-asl-1.9.13.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-core-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javassist-3.21.0-GA.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka-tools-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-jaxrs- base-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/rocksdbjni-5.7.3.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/connect-api-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javax.servlet-api-3.1.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/osgi-resource-locator-1.0.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-jaxrs-json-provider-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-servlets-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/log4j-1.2 .17.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-security-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jopt-simple-5.0.4.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/connect-file-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/httpmime-4.5.2.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-server-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-container-servlet-core-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-common-2.25.1.jar:/h ome/iguenkin/confluent-4.0.0/bin/../share/java/kafka/plexus-utils-3.0.24.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1-sources.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-servlet-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-client-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka-log4j-appender-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-beanutils-1.8.3.jar:/h ome/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka-streams-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/httpcore-4.4.4.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/maven-artifact-3.5.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/guava-20.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/zookeeper-3.4.10.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javassist-3.20.0-GA.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/slf4j-log4j12-1.7.25.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/k afka/support-metrics-client-4.0.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-digester-1.8.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/argparse4j-0.7.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-module-jaxb-annotations-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-logging-1.2.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/hk2-locator-2.5.0-b32.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-databind-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/ jetty-util-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-http-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/support-metrics-common-4.0.0.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka-clients-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-container-servlet-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/scala-library-2.11.11.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/avro-1.8.2.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kaf ka-streams-examples-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jersey-media-jaxb-2.25.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jackson-annotations-2.9.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1-test.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-io-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/javax.ws.rs-api-2.0.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/reflections-0.9.11.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/con nect-runtime-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1-scaladoc.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/kafka_2.11-1.0.0-cp1-test-sources.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-collections-3.2.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/jetty-server-9.2.22.v20170606.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-validator-1.4.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/paranamer-2.7.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/ka fka/httpclient-4.5.2.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/connect-transforms-1.0.0-cp1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/kafka/commons-lang3-3.1.jar:/home/iguenkin/confluent-4.0.0/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/*
6 os.spec = Linux, amd64, 3.16.0-37-generic
7 os.vcpus = 6
8 (org.apache.kafka.connect.runtime.WorkerInfo:71)
9 [2018-04-06 07:02:08,100] INFO Scanning for plugin classes. This might take a moment ... (org.apache.kafka.connect.cli.ConnectDistributed:69)
10 [2018-04-06 07:02:08,114] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-rest (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
11 [2018-04-06 07:02:10,716] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-rest/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
12 [2018-04-06 07:02:10,726] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-connect-hdfs (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
13 [2018-04-06 07:02:18,029] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-hdfs/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
14 [2018-04-06 07:02:18,030] INFO Added plugin 'io.confluent.connect.hdfs.tools.SchemaSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
15 [2018-04-06 07:02:18,030] INFO Added plugin 'io.confluent.connect.storage.tools.SchemaSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
16 [2018-04-06 07:02:18,030] INFO Added plugin 'io.confluent.connect.hdfs.HdfsSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
17 [2018-04-06 07:02:18,030] INFO Added plugin 'io.confluent.connect.avro.AvroConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
18 [2018-04-06 07:02:18,146] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/rest-utils (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
19 [2018-04-06 07:02:18,801] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/rest-utils/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
20 [2018-04-06 07:02:18,809] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-connect-s3 (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
21 [2018-04-06 07:02:25,430] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-s3/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
22 [2018-04-06 07:02:25,430] INFO Added plugin 'io.confluent.connect.s3.S3SinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
23 [2018-04-06 07:02:25,484] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
24 [2018-04-06 07:02:27,770] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
25 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.SchemaSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
26 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.MockConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
27 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.MockSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
28 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.VerifiableSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
29 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.file.FileStreamSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
30 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.MockSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
31 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.tools.VerifiableSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
32 [2018-04-06 07:02:27,770] INFO Added plugin 'org.apache.kafka.connect.file.FileStreamSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
33 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.json.JsonConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
34 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.converters.ByteArrayConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
35 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.storage.StringConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
36 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampConverter$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
37 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.Cast$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
38 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.MaskField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
39 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.HoistField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
40 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.InsertField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
41 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
42 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.MaskField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
43 [2018-04-06 07:02:27,771] INFO Added plugin 'org.apache.kafka.connect.transforms.TimestampConverter$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
44 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.ReplaceField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
45 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.ExtractField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
46 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.Cast$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
47 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.ValueToKey' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
48 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.ReplaceField$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
49 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.Flatten$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
50 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.HoistField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
51 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.SetSchemaMetadata$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
52 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.Flatten$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
53 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.SetSchemaMetadata$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
54 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.RegexRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
55 [2018-04-06 07:02:27,772] INFO Added plugin 'org.apache.kafka.connect.transforms.InsertField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
56 [2018-04-06 07:02:27,773] INFO Added plugin 'org.apache.kafka.connect.transforms.ExtractField$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
57 [2018-04-06 07:02:27,777] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-connect-storage-common (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
58 [2018-04-06 07:02:34,425] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-storage-common/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
59 [2018-04-06 07:02:34,477] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
60 [2018-04-06 07:02:34,700] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-serde-tools/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
61 [2018-04-06 07:02:34,701] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-connect-elasticsearch (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
62 [2018-04-06 07:02:35,121] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-elasticsearch/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
63 [2018-04-06 07:02:35,121] INFO Added plugin 'io.confluent.connect.elasticsearch.ElasticsearchSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
64 [2018-04-06 07:02:35,123] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/camus (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
65 [2018-04-06 07:02:36,522] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/camus/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
66 [2018-04-06 07:02:36,530] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/kafka-connect-jdbc (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
67 [2018-04-06 07:02:36,827] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/kafka-connect-jdbc/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
68 [2018-04-06 07:02:36,828] INFO Added plugin 'io.confluent.connect.jdbc.JdbcSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
69 [2018-04-06 07:02:36,828] INFO Added plugin 'io.confluent.connect.jdbc.JdbcSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:135)
70 [2018-04-06 07:02:36,847] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/confluent-common (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
71 [2018-04-06 07:02:37,004] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/confluent-common/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
72 [2018-04-06 07:02:37,006] INFO Loading plugin from: /home/iguenkin/confluent-4.0.0/share/java/schema-registry (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
73 [2018-04-06 07:02:38,480] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/confluent-4.0.0/share/java/schema-registry/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
74 [2018-04-06 07:02:38,498] INFO Loading plugin from: /home/iguenkin/debezium/debezium-connector-postgres (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:179)
75 [2018-04-06 07:02:38,633] INFO Registered loader: PluginClassLoader{pluginLocation=file:/home/iguenkin/debezium/debezium-connector-postgres/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
76 [2018-04-06 07:02:44,383] INFO Registered loader: sun.misc.Launcher$AppClassLoader@18dd7404 (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:202)
77 [2018-04-06 07:02:44,384] INFO Added aliases 'ElasticsearchSinkConnector' and 'ElasticsearchSink' to plugin 'io.confluent.connect.elasticsearch.ElasticsearchSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
78 [2018-04-06 07:02:44,385] INFO Added aliases 'HdfsSinkConnector' and 'HdfsSink' to plugin 'io.confluent.connect.hdfs.HdfsSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
79 [2018-04-06 07:02:44,385] INFO Added aliases 'JdbcSinkConnector' and 'JdbcSink' to plugin 'io.confluent.connect.jdbc.JdbcSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
80 [2018-04-06 07:02:44,385] INFO Added aliases 'JdbcSourceConnector' and 'JdbcSource' to plugin 'io.confluent.connect.jdbc.JdbcSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
81 [2018-04-06 07:02:44,386] INFO Added aliases 'S3SinkConnector' and 'S3Sink' to plugin 'io.confluent.connect.s3.S3SinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
82 [2018-04-06 07:02:44,386] INFO Added aliases 'FileStreamSinkConnector' and 'FileStreamSink' to plugin 'org.apache.kafka.connect.file.FileStreamSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
83 [2018-04-06 07:02:44,387] INFO Added aliases 'FileStreamSourceConnector' and 'FileStreamSource' to plugin 'org.apache.kafka.connect.file.FileStreamSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
84 [2018-04-06 07:02:44,387] INFO Added aliases 'MockConnector' and 'Mock' to plugin 'org.apache.kafka.connect.tools.MockConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
85 [2018-04-06 07:02:44,387] INFO Added aliases 'MockSinkConnector' and 'MockSink' to plugin 'org.apache.kafka.connect.tools.MockSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
86 [2018-04-06 07:02:44,388] INFO Added aliases 'MockSourceConnector' and 'MockSource' to plugin 'org.apache.kafka.connect.tools.MockSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
87 [2018-04-06 07:02:44,388] INFO Added aliases 'VerifiableSinkConnector' and 'VerifiableSink' to plugin 'org.apache.kafka.connect.tools.VerifiableSinkConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
88 [2018-04-06 07:02:44,389] INFO Added aliases 'VerifiableSourceConnector' and 'VerifiableSource' to plugin 'org.apache.kafka.connect.tools.VerifiableSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
89 [2018-04-06 07:02:44,389] INFO Added aliases 'AvroConverter' and 'Avro' to plugin 'io.confluent.connect.avro.AvroConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
90 [2018-04-06 07:02:44,389] INFO Added aliases 'ByteArrayConverter' and 'ByteArray' to plugin 'org.apache.kafka.connect.converters.ByteArrayConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
91 [2018-04-06 07:02:44,389] INFO Added aliases 'JsonConverter' and 'Json' to plugin 'org.apache.kafka.connect.json.JsonConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
92 [2018-04-06 07:02:44,390] INFO Added aliases 'StringConverter' and 'String' to plugin 'org.apache.kafka.connect.storage.StringConverter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:330)
93 [2018-04-06 07:02:44,392] INFO Added alias 'RegexRouter' to plugin 'org.apache.kafka.connect.transforms.RegexRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:327)
94 [2018-04-06 07:02:44,393] INFO Added alias 'TimestampRouter' to plugin 'org.apache.kafka.connect.transforms.TimestampRouter' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:327)
95 [2018-04-06 07:02:44,393] INFO Added alias 'ValueToKey' to plugin 'org.apache.kafka.connect.transforms.ValueToKey' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:327)
96 [2018-04-06 07:02:44,417] INFO DistributedConfig values:
97 access.control.allow.methods =
98 access.control.allow.origin =
99 bootstrap.servers = [localhost:9092]
100 client.id =
101 config.storage.replication.factor = 1
102 config.storage.topic = connect-configs
103 connections.max.idle.ms = 540000
104 group.id = connect-cluster
105 heartbeat.interval.ms = 3000
106 internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
107 internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
108 key.converter = class io.confluent.connect.avro.AvroConverter
109 metadata.max.age.ms = 300000
110 metric.reporters = []
111 metrics.num.samples = 2
112 metrics.recording.level = INFO
113 metrics.sample.window.ms = 30000
114 offset.flush.interval.ms = 60000
115 offset.flush.timeout.ms = 5000
116 offset.storage.partitions = 25
117 offset.storage.replication.factor = 1
118 offset.storage.topic = connect-offsets
119 plugin.path = [/home/iguenkin/confluent-4.0.0/share/java, /home/iguenkin/debezium]
120 rebalance.timeout.ms = 60000
121 receive.buffer.bytes = 32768
122 reconnect.backoff.max.ms = 1000
123 reconnect.backoff.ms = 50
124 request.timeout.ms = 40000
125 rest.advertised.host.name = localhost
126 rest.advertised.port = 8083
127 rest.host.name = localhost
128 rest.port = 8083
129 retry.backoff.ms = 100
130 sasl.jaas.config = null
131 sasl.kerberos.kinit.cmd = /usr/bin/kinit
132 sasl.kerberos.min.time.before.relogin = 60000
133 sasl.kerberos.service.name = null
134 sasl.kerberos.ticket.renew.jitter = 0.05
135 sasl.kerberos.ticket.renew.window.factor = 0.8
136 sasl.mechanism = GSSAPI
137 security.protocol = PLAINTEXT
138 send.buffer.bytes = 131072
139 session.timeout.ms = 10000
140 ssl.cipher.suites = null
141 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
142 ssl.endpoint.identification.algorithm = null
143 ssl.key.password = null
144 ssl.keymanager.algorithm = SunX509
145 ssl.keystore.location = null
146 ssl.keystore.password = null
147 ssl.keystore.type = JKS
148 ssl.protocol = TLS
149 ssl.provider = null
150 ssl.secure.random.implementation = null
151 ssl.trustmanager.algorithm = PKIX
152 ssl.truststore.location = null
153 ssl.truststore.password = null
154 ssl.truststore.type = JKS
155 status.storage.partitions = 5
156 status.storage.replication.factor = 1
157 status.storage.topic = connect-statuses
158 task.shutdown.graceful.timeout.ms = 5000
159 value.converter = class io.confluent.connect.avro.AvroConverter
160 worker.sync.timeout.ms = 3000
161 worker.unsync.backoff.ms = 300000
162 (org.apache.kafka.connect.runtime.distributed.DistributedConfig:223)
163 [2018-04-06 07:02:44,601] INFO Logging initialized @36918ms (org.eclipse.jetty.util.log:186)
164 [2018-04-06 07:02:44,797] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
165 [2018-04-06 07:02:44,797] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
166 [2018-04-06 07:02:44,883] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
167 [2018-04-06 07:02:44,883] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
168 [2018-04-06 07:02:44,887] INFO Kafka Connect distributed worker initialization took 36802ms (org.apache.kafka.connect.cli.ConnectDistributed:91)
169 [2018-04-06 07:02:44,887] INFO Kafka Connect starting (org.apache.kafka.connect.runtime.Connect:49)
170 [2018-04-06 07:02:44,888] INFO Starting REST server (org.apache.kafka.connect.runtime.rest.RestServer:98)
171 [2018-04-06 07:02:44,888] INFO Herder starting (org.apache.kafka.connect.runtime.distributed.DistributedHerder:203)
172 [2018-04-06 07:02:44,889] INFO Worker starting (org.apache.kafka.connect.runtime.Worker:142)
173 [2018-04-06 07:02:44,890] INFO Starting KafkaOffsetBackingStore (org.apache.kafka.connect.storage.KafkaOffsetBackingStore:108)
174 [2018-04-06 07:02:44,890] INFO Starting KafkaBasedLog with topic connect-offsets (org.apache.kafka.connect.util.KafkaBasedLog:124)
175 [2018-04-06 07:02:44,899] INFO AdminClientConfig values:
176 bootstrap.servers = [localhost:9092]
177 client.id =
178 connections.max.idle.ms = 300000
179 metadata.max.age.ms = 300000
180 metric.reporters = []
181 metrics.num.samples = 2
182 metrics.recording.level = INFO
183 metrics.sample.window.ms = 30000
184 receive.buffer.bytes = 65536
185 reconnect.backoff.max.ms = 1000
186 reconnect.backoff.ms = 50
187 request.timeout.ms = 120000
188 retries = 5
189 retry.backoff.ms = 100
190 sasl.jaas.config = null
191 sasl.kerberos.kinit.cmd = /usr/bin/kinit
192 sasl.kerberos.min.time.before.relogin = 60000
193 sasl.kerberos.service.name = null
194 sasl.kerberos.ticket.renew.jitter = 0.05
195 sasl.kerberos.ticket.renew.window.factor = 0.8
196 sasl.mechanism = GSSAPI
197 security.protocol = PLAINTEXT
198 send.buffer.bytes = 131072
199 ssl.cipher.suites = null
200 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
201 ssl.endpoint.identification.algorithm = null
202 ssl.key.password = null
203 ssl.keymanager.algorithm = SunX509
204 ssl.keystore.location = null
205 ssl.keystore.password = null
206 ssl.keystore.type = JKS
207 ssl.protocol = TLS
208 ssl.provider = null
209 ssl.secure.random.implementation = null
210 ssl.trustmanager.algorithm = PKIX
211 ssl.truststore.location = null
212 ssl.truststore.password = null
213 ssl.truststore.type = JKS
214 (org.apache.kafka.clients.admin.AdminClientConfig:223)
215 [2018-04-06 07:02:44,921] WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
216 [2018-04-06 07:02:44,921] WARN The configuration 'key.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
217 [2018-04-06 07:02:44,922] WARN The configuration 'internal.key.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
218 [2018-04-06 07:02:44,922] WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
219 [2018-04-06 07:02:44,922] WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
220 [2018-04-06 07:02:44,922] WARN The configuration 'offset.storage.file.filename' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
221 [2018-04-06 07:02:44,922] WARN The configuration 'internal.value.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
222 [2018-04-06 07:02:44,922] WARN The configuration 'value.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
223 [2018-04-06 07:02:44,922] WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
224 [2018-04-06 07:02:44,922] WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
225 [2018-04-06 07:02:44,922] WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
226 [2018-04-06 07:02:44,922] WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
227 [2018-04-06 07:02:44,923] WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
228 [2018-04-06 07:02:44,923] WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
229 [2018-04-06 07:02:44,923] WARN The configuration 'rest.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
:$
623 [2018-04-06 07:02:47,263] WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
624 [2018-04-06 07:02:47,263] WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
625 [2018-04-06 07:02:47,263] WARN The configuration 'internal.key.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
626 [2018-04-06 07:02:47,263] WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
627 [2018-04-06 07:02:47,263] WARN The configuration 'offset.storage.file.filename' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
628 [2018-04-06 07:02:47,263] WARN The configuration 'internal.value.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
629 [2018-04-06 07:02:47,263] WARN The configuration 'value.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
630 [2018-04-06 07:02:47,264] WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
631 [2018-04-06 07:02:47,264] WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
632 [2018-04-06 07:02:47,264] WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
633 [2018-04-06 07:02:47,264] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
634 [2018-04-06 07:02:47,264] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
635 [2018-04-06 07:02:47,292] INFO [Consumer clientId=consumer-2, groupId=connect-cluster] Discovered coordinator localhost:9092 (id: 2147483647 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:341)
636 [2018-04-06 07:02:47,300] INFO Finished reading KafkaBasedLog for topic connect-statuses (org.apache.kafka.connect.util.KafkaBasedLog:153)
637 [2018-04-06 07:02:47,301] INFO Started KafkaBasedLog for topic connect-statuses (org.apache.kafka.connect.util.KafkaBasedLog:155)
638 [2018-04-06 07:02:47,302] INFO Starting KafkaConfigBackingStore (org.apache.kafka.connect.storage.KafkaConfigBackingStore:244)
639 [2018-04-06 07:02:47,302] INFO Starting KafkaBasedLog with topic connect-configs (org.apache.kafka.connect.util.KafkaBasedLog:124)
640 [2018-04-06 07:02:47,306] INFO AdminClientConfig values:
641 bootstrap.servers = [localhost:9092]
642 client.id =
643 connections.max.idle.ms = 300000
644 metadata.max.age.ms = 300000
645 metric.reporters = []
646 metrics.num.samples = 2
647 metrics.recording.level = INFO
648 metrics.sample.window.ms = 30000
649 receive.buffer.bytes = 65536
650 reconnect.backoff.max.ms = 1000
651 reconnect.backoff.ms = 50
652 request.timeout.ms = 120000
653 retries = 5
654 retry.backoff.ms = 100
655 sasl.jaas.config = null
656 sasl.kerberos.kinit.cmd = /usr/bin/kinit
657 sasl.kerberos.min.time.before.relogin = 60000
658 sasl.kerberos.service.name = null
659 sasl.kerberos.ticket.renew.jitter = 0.05
660 sasl.kerberos.ticket.renew.window.factor = 0.8
661 sasl.mechanism = GSSAPI
662 security.protocol = PLAINTEXT
663 send.buffer.bytes = 131072
664 ssl.cipher.suites = null
665 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
666 ssl.endpoint.identification.algorithm = null
667 ssl.key.password = null
668 ssl.keymanager.algorithm = SunX509
669 ssl.keystore.location = null
670 ssl.keystore.password = null
671 ssl.keystore.type = JKS
672 ssl.protocol = TLS
673 ssl.provider = null
674 ssl.secure.random.implementation = null
675 ssl.trustmanager.algorithm = PKIX
676 ssl.truststore.location = null
677 ssl.truststore.password = null
678 ssl.truststore.type = JKS
679 (org.apache.kafka.clients.admin.AdminClientConfig:223)
680 [2018-04-06 07:02:47,312] WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
681 [2018-04-06 07:02:47,312] WARN The configuration 'key.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
682 [2018-04-06 07:02:47,312] WARN The configuration 'internal.key.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
683 [2018-04-06 07:02:47,313] WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
684 [2018-04-06 07:02:47,313] WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
685 [2018-04-06 07:02:47,313] WARN The configuration 'offset.storage.file.filename' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
686 [2018-04-06 07:02:47,313] WARN The configuration 'internal.value.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
687 [2018-04-06 07:02:47,313] WARN The configuration 'value.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
688 [2018-04-06 07:02:47,313] WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
689 [2018-04-06 07:02:47,313] WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
690 [2018-04-06 07:02:47,313] WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
691 [2018-04-06 07:02:47,313] WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
692 [2018-04-06 07:02:47,313] WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
693 [2018-04-06 07:02:47,314] WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
694 [2018-04-06 07:02:47,314] WARN The configuration 'rest.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
695 [2018-04-06 07:02:47,314] WARN The configuration 'internal.value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
696 [2018-04-06 07:02:47,314] WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
697 [2018-04-06 07:02:47,314] WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
698 [2018-04-06 07:02:47,314] WARN The configuration 'internal.key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
699 [2018-04-06 07:02:47,314] WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
700 [2018-04-06 07:02:47,314] WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig:231)
701 [2018-04-06 07:02:47,314] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
702 [2018-04-06 07:02:47,314] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
703 [2018-04-06 07:02:47,523] INFO Created topic (name=connect-configs, numPartitions=1, replicationFactor=1, replicasAssignments=null, configs={cleanup.policy=compact}) on brokers at localhost:9092 (org.apache.kafka.connect.util.TopicAdmin:228)
704 [2018-04-06 07:02:47,545] INFO ProducerConfig values:
705 acks = all
706 batch.size = 16384
707 bootstrap.servers = [localhost:9092]
708 buffer.memory = 33554432
709 client.id =
710 compression.type = none
711 confluent.batch.expiry.ms = 30000
712 connections.max.idle.ms = 540000
713 enable.idempotence = false
714 interceptor.classes = null
715 key.serializer = class org.apache.kafka.common.serialization.StringSerializer
716 linger.ms = 0
717 max.block.ms = 60000
718 max.in.flight.requests.per.connection = 1
719 max.request.size = 1048576
720 metadata.max.age.ms = 300000
721 metric.reporters = []
722 metrics.num.samples = 2
723 metrics.recording.level = INFO
724 metrics.sample.window.ms = 30000
725 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
726 receive.buffer.bytes = 32768
727 reconnect.backoff.max.ms = 1000
728 reconnect.backoff.ms = 50
729 request.timeout.ms = 30000
730 retries = 2147483647
731 retry.backoff.ms = 100
732 sasl.jaas.config = null
733 sasl.kerberos.kinit.cmd = /usr/bin/kinit
734 sasl.kerberos.min.time.before.relogin = 60000
735 sasl.kerberos.service.name = null
736 sasl.kerberos.ticket.renew.jitter = 0.05
737 sasl.kerberos.ticket.renew.window.factor = 0.8
738 sasl.mechanism = GSSAPI
739 security.protocol = PLAINTEXT
740 send.buffer.bytes = 131072
741 ssl.cipher.suites = null
742 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
743 ssl.endpoint.identification.algorithm = null
744 ssl.key.password = null
745 ssl.keymanager.algorithm = SunX509
746 ssl.keystore.location = null
747 ssl.keystore.password = null
748 ssl.keystore.type = JKS
749 ssl.protocol = TLS
750 ssl.provider = null
751 ssl.secure.random.implementation = null
752 ssl.trustmanager.algorithm = PKIX
753 ssl.truststore.location = null
754 ssl.truststore.password = null
755 ssl.truststore.type = JKS
756 transaction.timeout.ms = 60000
757 transactional.id = null
758 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
759 (org.apache.kafka.clients.producer.ProducerConfig:223)
760 [2018-04-06 07:02:47,557] WARN The configuration 'key.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
761 [2018-04-06 07:02:47,558] WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
762 [2018-04-06 07:02:47,558] WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
763 [2018-04-06 07:02:47,558] WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
764 [2018-04-06 07:02:47,558] WARN The configuration 'internal.value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
765 [2018-04-06 07:02:47,558] WARN The configuration 'rest.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
766 [2018-04-06 07:02:47,558] WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
767 [2018-04-06 07:02:47,558] WARN The configuration 'internal.key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
768 [2018-04-06 07:02:47,558] WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
769 [2018-04-06 07:02:47,558] WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
770 [2018-04-06 07:02:47,559] WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
771 [2018-04-06 07:02:47,559] WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
772 [2018-04-06 07:02:47,559] WARN The configuration 'internal.key.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
773 [2018-04-06 07:02:47,559] WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
774 [2018-04-06 07:02:47,559] WARN The configuration 'offset.storage.file.filename' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
775 [2018-04-06 07:02:47,559] WARN The configuration 'value.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
776 [2018-04-06 07:02:47,559] WARN The configuration 'internal.value.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
777 [2018-04-06 07:02:47,559] WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
778 [2018-04-06 07:02:47,559] WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
779 [2018-04-06 07:02:47,559] WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
780 [2018-04-06 07:02:47,559] WARN The configuration 'group.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:231)
781 [2018-04-06 07:02:47,560] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
782 [2018-04-06 07:02:47,560] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
783 [2018-04-06 07:02:47,561] INFO ConsumerConfig values:
784 auto.commit.interval.ms = 5000
785 auto.offset.reset = earliest
786 bootstrap.servers = [localhost:9092]
787 check.crcs = true
788 client.id =
789 connections.max.idle.ms = 540000
790 enable.auto.commit = false
791 exclude.internal.topics = true
792 fetch.max.bytes = 52428800
793 fetch.max.wait.ms = 500
794 fetch.min.bytes = 1
795 group.id = connect-cluster
796 heartbeat.interval.ms = 3000
797 interceptor.classes = null
798 internal.leave.group.on.close = true
799 isolation.level = read_uncommitted
800 key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
801 max.partition.fetch.bytes = 1048576
802 max.poll.interval.ms = 300000
803 max.poll.records = 500
804 metadata.max.age.ms = 300000
805 metric.reporters = []
806 metrics.num.samples = 2
807 metrics.recording.level = INFO
808 metrics.sample.window.ms = 30000
809 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
810 receive.buffer.bytes = 65536
811 reconnect.backoff.max.ms = 1000
812 reconnect.backoff.ms = 50
813 request.timeout.ms = 305000
814 retry.backoff.ms = 100
815 sasl.jaas.config = null
816 sasl.kerberos.kinit.cmd = /usr/bin/kinit
817 sasl.kerberos.min.time.before.relogin = 60000
818 sasl.kerberos.service.name = null
819 sasl.kerberos.ticket.renew.jitter = 0.05
820 sasl.kerberos.ticket.renew.window.factor = 0.8
821 sasl.mechanism = GSSAPI
822 security.protocol = PLAINTEXT
823 send.buffer.bytes = 131072
824 session.timeout.ms = 10000
825 ssl.cipher.suites = null
826 ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
827 ssl.endpoint.identification.algorithm = null
828 ssl.key.password = null
829 ssl.keymanager.algorithm = SunX509
830 ssl.keystore.location = null
831 ssl.keystore.password = null
832 ssl.keystore.type = JKS
833 ssl.protocol = TLS
834 ssl.provider = null
835 ssl.secure.random.implementation = null
836 ssl.trustmanager.algorithm = PKIX
837 ssl.truststore.location = null
838 ssl.truststore.password = null
839 ssl.truststore.type = JKS
840 value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
841 (org.apache.kafka.clients.consumer.ConsumerConfig:223)
842 [2018-04-06 07:02:47,569] WARN The configuration 'key.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
843 [2018-04-06 07:02:47,570] WARN The configuration 'status.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
844 [2018-04-06 07:02:47,570] WARN The configuration 'offset.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
845 [2018-04-06 07:02:47,570] WARN The configuration 'rest.advertised.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
846 [2018-04-06 07:02:47,570] WARN The configuration 'rest.host.name' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
847 [2018-04-06 07:02:47,570] WARN The configuration 'internal.value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
848 [2018-04-06 07:02:47,570] WARN The configuration 'offset.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
849 [2018-04-06 07:02:47,570] WARN The configuration 'config.storage.replication.factor' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
850 [2018-04-06 07:02:47,570] WARN The configuration 'internal.key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
851 [2018-04-06 07:02:47,571] WARN The configuration 'status.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
852 [2018-04-06 07:02:47,571] WARN The configuration 'plugin.path' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
853 [2018-04-06 07:02:47,571] WARN The configuration 'config.storage.topic' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
854 [2018-04-06 07:02:47,571] WARN The configuration 'internal.key.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
855 [2018-04-06 07:02:47,571] WARN The configuration 'value.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
856 [2018-04-06 07:02:47,571] WARN The configuration 'offset.storage.file.filename' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
857 [2018-04-06 07:02:47,571] WARN The configuration 'internal.value.converter.schemas.enable' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
858 [2018-04-06 07:02:47,571] WARN The configuration 'value.converter.schema.registry.url' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
859 [2018-04-06 07:02:47,571] WARN The configuration 'rest.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
860 [2018-04-06 07:02:47,571] WARN The configuration 'key.converter' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
861 [2018-04-06 07:02:47,571] WARN The configuration 'rest.advertised.port' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:231)
862 [2018-04-06 07:02:47,571] INFO Kafka version : 1.0.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
863 [2018-04-06 07:02:47,572] INFO Kafka commitId : bedb2a8697fecd0d (org.apache.kafka.common.utils.AppInfoParser:110)
864 [2018-04-06 07:02:47,595] INFO [Consumer clientId=consumer-3, groupId=connect-cluster] Discovered coordinator localhost:9092 (id: 2147483647 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:341)
865 [2018-04-06 07:02:47,604] INFO Finished reading KafkaBasedLog for topic connect-configs (org.apache.kafka.connect.util.KafkaBasedLog:153)
866 [2018-04-06 07:02:47,604] INFO Started KafkaBasedLog for topic connect-configs (org.apache.kafka.connect.util.KafkaBasedLog:155)
867 [2018-04-06 07:02:47,605] INFO Started KafkaConfigBackingStore (org.apache.kafka.connect.storage.KafkaConfigBackingStore:249)
868 [2018-04-06 07:02:47,607] INFO Herder started (org.apache.kafka.connect.runtime.distributed.DistributedHerder:207)
869 [2018-04-06 07:02:47,617] INFO [Worker clientId=connect-1, groupId=connect-cluster] Discovered coordinator localhost:9092 (id: 2147483647 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:341)
870 [2018-04-06 07:02:47,619] INFO [Worker clientId=connect-1, groupId=connect-cluster] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:336)
871 [2018-04-06 07:02:47,689] INFO [Worker clientId=connect-1, groupId=connect-cluster] Successfully joined group with generation 1 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:341)
872 [2018-04-06 07:02:47,691] INFO Joined group and got assignment: Assignment{error=0, leader='connect-1-5947cc6d-ba2e-4d2a-be49-5d1d5d7cf6cc', leaderUrl='http://localhost:8083/', offset=-1, connectorIds=[], taskIds=[]} (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1192)
873 [2018-04-06 07:02:47,691] INFO Starting connectors and tasks using config offset -1 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:837)
874 [2018-04-06 07:02:47,691] INFO Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder:847)
875 [2018-04-06 07:02:50,963] INFO 127.0.0.1 - - [06/Apr/2018:07:02:50 +0000] "GET /connector-plugins HTTP/1.1" 200 878 151 (org.apache.kafka.connect.runtime.rest.RestServer:60)
876 [2018-04-06 07:03:04,033] INFO 127.0.0.1 - - [06/Apr/2018:07:03:04 +0000] "GET /connector-plugins HTTP/1.1" 200 878 12 (org.apache.kafka.connect.runtime.rest.RestServer:60)
877 [2018-04-06 07:03:13,961] INFO 127.0.0.1 - - [06/Apr/2018:07:03:13 +0000] "GET /connector-plugins HTTP/1.1" 200 878 3 (org.apache.kafka.connect.runtime.rest.RestServer:60)
Jiri Pechanec
Apr 6, 2018, 3:54:44 AM4/6/18
to debezium
Very strange
could you plase post a result of ls -lR /home/iguenkin/debezium/
could you plase post a result of ls -lR /home/iguenkin/debezium/
igue...@rocketlawyer.com
Apr 6, 2018, 11:15:58 AM4/6/18
to debezium
iguenkin@rllasinfradb001:/tmp/confluent.TSg5k9fn/connect$ ls -lR /home/iguenkin/debezium
/home/iguenkin/debezium:
total 4
drwxrwxr-x 2 iguenkin iguenkin 4096 Apr 6 06:58 debezium-connector-postgres
/home/iguenkin/debezium/debezium-connector-postgres:
total 2080
-rw-r--r-- 1 iguenkin iguenkin 62323 Apr 6 06:58 CHANGELOG.md
-rw-r--r-- 1 iguenkin iguenkin 14236 Apr 6 06:58 CONTRIBUTE.md
-rw-r--r-- 1 iguenkin iguenkin 690 Apr 6 06:58 COPYRIGHT.txt
-rw-r--r-- 1 iguenkin iguenkin 197615 Apr 6 06:58 debezium-connector-postgres-0.7.5.jar
-rw-r--r-- 1 iguenkin iguenkin 504097 Apr 6 06:58 debezium-core-0.7.5.jar
-rw-r--r-- 1 iguenkin iguenkin 11357 Apr 6 06:58 LICENSE.txt
-rw-r--r-- 1 iguenkin iguenkin 707261 Apr 6 06:58 postgresql-42.0.0.jar
-rw-r--r-- 1 iguenkin iguenkin 596642 Apr 6 06:58 protobuf-java-2.6.1.jar
-rw-r--r-- 1 iguenkin iguenkin 12609 Apr 6 06:58 README.md
iguenkin@rllasinfradb001:/tmp/confluent.TSg5k9fn/connect$
Gunnar Morling
Apr 6, 2018, 12:52:54 PM4/6/18
to debezium
Hi,
> Kafka Connect finds the plugins using its plugin path, which is a comma-separated list of
> directories defined in the Kafka Connect’s worker configuration. To install a plugin, place
> the plugin directory or uber JAR (or a symbolic link that resolves to one of those) in a
> directory listed on the plugin path
--Gunnar
Just to double check, do you have added "/home/iguenkin/debezium/" (and *not* "/home/iguenkin/debezium/debezium-connector-postgres") added to your plug-in path? That's how it should be done as per the Kafka Connect docs:
> directories defined in the Kafka Connect’s worker configuration. To install a plugin, place
> the plugin directory or uber JAR (or a symbolic link that resolves to one of those) in a
> directory listed on the plugin path
--Gunnar
igue...@rocketlawyer.com
Apr 6, 2018, 12:59:19 PM4/6/18
to debezium
Yes,
here the entry from connect-avro-distributed.properties file
plugin.path=share/java,/home/iguenkin/debeziumGunnar Morling
Apr 6, 2018, 3:38:40 PM4/6/18
to debezium
Hum, this looks correct.
You could try and just have a single entry (plugin.path=/home/iguenkin/debezium), so to make sure it's not related to multiple entries being given (although "," is the right separator as per the Connect docs). Are you sure that this config file is the one being used and not unintentionally another one. Otherwise, I'm out of ideas.
igue...@rocketlawyer.com
Apr 6, 2018, 3:48:08 PM4/6/18
to debezium
Gunnar,
I'm positive that this is a correct config file.
I think I know what the problem is.
machine I'm installing and configuring kafka/debezium is an old ubuntu DB service.
it was not able to perform upgrade for all packages due to different dependencies conflict.
ig
uenkin@rllasinfradb001:~$ uname -a
Linux rllasinfradb001 3.16.0-37-generic #51~14.04.1-Ubuntu SMP Wed May 6 15:23:14 UTC 2015 x86_64 GNU/Linux
iguenkin@rllasinfradb001:~$ uptime
19:41:57 up 562 days, 21:55, 5 users, load average: 0.01, 0.07, 0.11
iguenkin@rllasinfradb001:~$I was able successfully install and load dibezium on my local (OSX) machine. I'll try to do same on SentOS vm and I hope it will work as expected
will inform you when it is done
Thanks for all your help
Nicolas Sornin
Apr 24, 2018, 3:11:23 AM4/24/18
to debezium
Hi guys,
I'm facing the exact same issue.
I'm trying to register postgres connector to an existing kafka connect deployed with docker. (debezium 0.7.5 & kafka connect 4.0.0)
Docker host is a Debian 9.3.
Did you manage to solve the problem ?
Thanks,
Regards,
Nicolas
Ilia Guenkin
Apr 24, 2018, 5:09:56 PM4/24/18
to debe...@googlegroups.com
mine solution was easy and the problem was )?) in an old OS,
the server I was running all setup was ~2 yrs old ubuntu and I was not able to update ut up to the latest OS version/patch level, after rebuilding (building a new one) worked as expected
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/c6e27e98-1928-40b2-b4df-c20b97302b22%40googlegroups.com.--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+unsubscribe@googlegroups.com.
To post to this group, send email to debe...@googlegroups.com.
Ilia Guenkin | Principal Database Administrator | igue...@rocketlawyer.com
Rocket Lawyer is the easy and affordable legal service for everyone. Our legal documents are free, and our Rocket Lawyer On Call® legal plans give individuals, families and businesses affordable access to licensed attorneys, plus a whole lot more. Since Rocket Lawyer is not a law firm, we don't provide legal advice. We deliver the legal services you need at a price you'll love.
Incorporations | Contracts | Wills and Estates | Marriage | Divorce | Lawyers
Reply all
Reply to author
Forward
0 new messages