Not able to connect Confluent Kafka with ElasticSearch on Windows
370 views
Skip to first unread message
Rahul
Feb 7, 2018, 2:58:18 AM2/7/18
to Confluent Platform
Hi,
I am running below command on confluent home directory (zip extract home directory)-
.\bin\windows\connect-standalone.bat .\etc\kafka\connect-standalone.properties .\etc\kafka-connect-elasticsearch\quickstart-elasticsearch.properties
connect-standalone.properties have below values-
bootstrap.servers=localhost:9092
key.converter.schemas.enable=true
value.converter.schemas.enable=true
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
offset.storage.file.filename=/tmp/connect.offsets
offset.flush.interval.ms=10000
plugin.path= share/java
quickstart-elasticsearch.properties have below properties
name=elasticsearch-sink
connector.class=io.confluent.connect.elasticsearch.ElasticsearchSinkConnector
tasks.max=1
topics=test-elasticsearch-sink
key.ignore=true
connection.url=http://localhost:9200
type.name=kafka-connect
After running command It is not able to find connector classes in build path and giving below errors-
2018-02-07 13:08:36,349] WARN could not get type for name com.amazonaws.handler
.RequestHandler from any class loader (org.reflections.Reflections)
rg.reflections.ReflectionsException: could not get type for name com.amazonaws.
andlers.RequestHandler
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: com.amazonaws.handlers.RequestHandl
r
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,364] WARN could not get type for name io.confluent.connect.
torage.StorageSinkConnectorConfig from any class loader (org.reflections.Reflec
ions)
rg.reflections.ReflectionsException: could not get type for name io.confluent.c
nnect.storage.StorageSinkConnectorConfig
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: io.confluent.connect.storage.Storag
SinkConnectorConfig
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,364] WARN could not get type for name com.amazonaws.util.AW
RequestMetrics from any class loader (org.reflections.Reflections)
rg.reflections.ReflectionsException: could not get type for name com.amazonaws.
til.AWSRequestMetrics
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: com.amazonaws.util.AWSRequestMetric
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,364] WARN could not get type for name software.amazon.ion.i
pl.PrivateIonValue$SymbolTableProvider from any class loader (org.reflections.R
flections)
rg.reflections.ReflectionsException: could not get type for name software.amazo
.ion.impl.PrivateIonValue$SymbolTableProvider
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: software.amazon.ion.impl.PrivateIon
alue$SymbolTableProvider
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,380] WARN could not get type for name com.amazonaws.util.Im
utableMapParameter$Builder from any class loader (org.reflections.Reflections)
rg.reflections.ReflectionsException: could not get type for name com.amazonaws.
til.ImmutableMapParameter$Builder
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: com.amazonaws.util.ImmutableMapPara
eter$Builder
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,380] WARN could not get type for name com.amazonaws.event.P
ogressEvent from any class loader (org.reflections.Reflections)
rg.reflections.ReflectionsException: could not get type for name com.amazonaws.
vent.ProgressEvent
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: com.amazonaws.event.ProgressEvent
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,380] WARN could not get type for name com.amazonaws.auth.Si
ner from any class loader (org.reflections.Reflections)
rg.reflections.ReflectionsException: could not get type for name com.amazonaws.
uth.Signer
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
luginPath(DelegatingClassLoader.java:258)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scan
rlsAndAddPlugins(DelegatingClassLoader.java:201)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.regi
terPlugin(DelegatingClassLoader.java:193)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.init
oaders(DelegatingClassLoader.java:153)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.jav
:47)
at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone
java:75)
aused by: java.lang.ClassNotFoundException: com.amazonaws.auth.Signer
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 8 more
2018-02-07 13:08:36,395] WARN could not get type for name com.amazonaws.jmespatCan you please help to run Confluent Kafka connector with ElasticSearch on Windows?
Thanks.
Reply all
Reply to author
Forward
0 new messages