kafka-connect-syslog-master

304 views
Skip to first unread message

magesh_pk

unread,
Mar 1, 2017, 10:10:32 AM3/1/17
to Confluent Platform
i am trying to install and configure kafka-connect-syslog-master. 

while starting i am receiving this error "Failed to find any class that implements Connector and which name matches io.confluent.kafka.connect.syslog.source.TCPSyslogSourceConnector". Please suggest.


[root@xyz456 confluent-3.1.1]# ./bin/connect-standalone ./etc/schema-registry/connect-avro-standalone.properties /opt/splunk/confluent-3.1.1/etc/kafka-connect-syslog-master/config/tcpsyslog.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/splunk/confluent-3.1.1/share/java/kafka-serde-tools/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/splunk/confluent-3.1.1/share/java/kafka-connect-elasticsearch/slf4j-simple-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/splunk/confluent-3.1.1/share/java/kafka-connect-hdfs/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/splunk/confluent-3.1.1/share/java/kafka/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[2017-03-01 14:54:26,420] INFO StandaloneConfig values: 
        access.control.allow.methods = 
        access.control.allow.origin = 
        bootstrap.servers = [localhost:9092]
        internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
        internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
        key.converter = class io.confluent.connect.avro.AvroConverter
        offset.flush.interval.ms = 60000
        offset.flush.timeout.ms = 5000
        offset.storage.file.filename = /tmp/connect.offsets
        rest.advertised.host.name = null
        rest.advertised.port = null
        rest.host.name = null
        rest.port = 8083
        value.converter = class io.confluent.connect.avro.AvroConverter
 (org.apache.kafka.connect.runtime.standalone.StandaloneConfig:180)
[2017-03-01 14:54:26,625] INFO Logging initialized @1033ms (org.eclipse.jetty.util.log:186)
[2017-03-01 14:54:27,369] INFO Kafka Connect starting (org.apache.kafka.connect.runtime.Connect:52)
[2017-03-01 14:54:27,369] INFO Herder starting (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:70)
[2017-03-01 14:54:27,369] INFO Worker starting (org.apache.kafka.connect.runtime.Worker:113)
[2017-03-01 14:54:27,370] INFO Starting FileOffsetBackingStore with file /tmp/connect.offsets (org.apache.kafka.connect.storage.FileOffsetBackingStore:60)
[2017-03-01 14:54:27,432] INFO Worker started (org.apache.kafka.connect.runtime.Worker:118)
[2017-03-01 14:54:27,433] INFO Herder started (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:72)
[2017-03-01 14:54:27,433] INFO Starting REST server (org.apache.kafka.connect.runtime.rest.RestServer:98)
[2017-03-01 14:54:27,687] INFO jetty-9.2.15.v20160210 (org.eclipse.jetty.server.Server:327)
Mar 01, 2017 2:54:29 PM org.glassfish.jersey.internal.Errors logErrors
WARNING: The following warnings have been detected: WARNING: The (sub)resource method listConnectors in org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource contains empty path annotation.
WARNING: The (sub)resource method createConnector in org.apache.kafka.connect.runtime.rest.resources.ConnectorsResource contains empty path annotation.
WARNING: The (sub)resource method listConnectorPlugins in org.apache.kafka.connect.runtime.rest.resources.ConnectorPluginsResource contains empty path annotation.
WARNING: The (sub)resource method serverInfo in org.apache.kafka.connect.runtime.rest.resources.RootResource contains empty path annotation.

[2017-03-01 14:54:29,018] INFO Started o.e.j.s.ServletContextHandler@660e9100{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:744)
[2017-03-01 14:54:29,037] INFO Started ServerConnector@43b47c95{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:266)
[2017-03-01 14:54:29,037] INFO Started @3447ms (org.eclipse.jetty.server.Server:379)
[2017-03-01 14:54:29,043] INFO REST server listening at http://10.211.xxx.xxx:8083/, advertising URL http://10.211.xxx.xxx:8083/ (org.apache.kafka.connect.runtime.rest.RestServer:150)
[2017-03-01 14:54:29,043] INFO Kafka Connect started (org.apache.kafka.connect.runtime.Connect:58)
[2017-03-01 14:54:29,048] INFO ConnectorConfig values: 
        connector.class = io.confluent.kafka.connect.syslog.source.TCPSyslogSourceConnector
        key.converter = null
        name = tcpsyslog
        tasks.max = 1
        value.converter = null
 (org.apache.kafka.connect.runtime.ConnectorConfig:180)
[2017-03-01 14:54:29,050] INFO Creating connector tcpsyslog of type io.confluent.kafka.connect.syslog.source.TCPSyslogSourceConnector (org.apache.kafka.connect.runtime.Worker:159)
[2017-03-01 14:54:38,369] INFO Reflections took 10818 ms to scan 264 urls, producing 12034 keys and 80062 values  (org.reflections.Reflections:229)
[2017-03-01 14:54:39,488] INFO Reflections took 10421 ms to scan 264 urls, producing 12034 keys and 80062 values  (org.reflections.Reflections:229)
[2017-03-01 14:54:39,490] ERROR Failed to start connector tcpsyslog (org.apache.kafka.connect.runtime.Worker:166)
org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.kafka.connect.syslog.source.TCPSyslogSourceConnector, available connectors are: org.apache.kafka.connect.file.FileStreamSinkConnector, io.confluent.connect.hdfs.tools.SchemaSourceConnector, io.confluent.connect.jdbc.JdbcSourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, io.confluent.connect.elasticsearch.ElasticsearchSinkConnector, io.confluent.connect.hdfs.HdfsSinkConnector, io.confluent.connect.jdbc.JdbcSinkConnector, org.apache.kafka.connect.source.SourceConnector, org.apache.kafka.connect.tools.MockConnector, org.apache.kafka.connect.tools.MockSinkConnector, org.apache.kafka.connect.tools.VerifiableSourceConnector, org.apache.kafka.connect.tools.SchemaSourceConnector, org.apache.kafka.connect.file.FileStreamSourceConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.sink.SinkConnector
        at org.apache.kafka.connect.runtime.ConnectorFactory.getConnectorClass(ConnectorFactory.java:84)
        at org.apache.kafka.connect.runtime.ConnectorFactory.newConnector(ConnectorFactory.java:38)
        at org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:160)
        at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.startConnector(StandaloneHerder.java:237)
        at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:159)
        at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:96)
[2017-03-01 14:54:39,494] ERROR Failed to create job for /opt/splunk/confluent-3.1.1/etc/kafka-connect-syslog-master/config/tcpsyslog.properties (org.apache.kafka.connect.cli.ConnectStandalone:91)
[2017-03-01 14:54:39,494] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:102)
java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to start connector: tcpsyslog
        at org.apache.kafka.connect.util.ConvertingFutureCallback.result(ConvertingFutureCallback.java:80)
        at org.apache.kafka.connect.util.ConvertingFutureCallback.get(ConvertingFutureCallback.java:67)
        at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:99)
Caused by: org.apache.kafka.connect.errors.ConnectException: Failed to start connector: tcpsyslog
        at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:160)
        at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:96)
[2017-03-01 14:54:39,495] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:68)
[2017-03-01 14:54:39,495] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:154)
[2017-03-01 14:54:39,513] INFO Stopped ServerConnector@43b47c95{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:306)
[2017-03-01 14:54:39,526] INFO Stopped o.e.j.s.ServletContextHandler@660e9100{/,null,UNAVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:865)
[2017-03-01 14:54:39,529] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:165)
[2017-03-01 14:54:39,529] INFO Herder stopping (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:76)
[2017-03-01 14:54:39,529] INFO Stopping connector tcpsyslog (org.apache.kafka.connect.runtime.Worker:218)
[2017-03-01 14:54:39,530] WARN Ignoring stop request for unowned connector tcpsyslog (org.apache.kafka.connect.runtime.Worker:222)
[2017-03-01 14:54:39,530] INFO Worker stopping (org.apache.kafka.connect.runtime.Worker:122)
[2017-03-01 14:54:39,530] INFO Stopped FileOffsetBackingStore (org.apache.kafka.connect.storage.FileOffsetBackingStore:68)
[2017-03-01 14:54:39,530] INFO Worker stopped (org.apache.kafka.connect.runtime.Worker:142)
[2017-03-01 14:54:39,531] INFO Herder stopped (org.apache.kafka.connect.runtime.standalone.StandaloneHerder:86)
[2017-03-01 14:54:39,531] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:73)

Dustin Cote

unread,
Mar 1, 2017, 11:07:13 AM3/1/17
to confluent...@googlegroups.com
It looks like the Connector plugin you are trying to use isn't available to the worker. It should be on the CLASSPATH to use it. There's some more information on how to do this in the docs:

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/74b5fb47-87b4-44aa-aa3c-8132ec62add0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Dustin Cote
Customer Operations Engineer | Confluent
Follow us: Twitter | blog
Reply all
Reply to author
Forward
0 new messages