Connect Framework shutting down - exceptions are not catching

261 views
Skip to first unread message

Sreejith S

unread,
Feb 14, 2017, 8:59:01 AM2/14/17
to Confluent Platform
Hi All,

Connect framework shutting down due to uncaught exception. The scenario is if i register a connector but its jar is not deployed in kafka , getting below exception. 

Ideally this might not be the case in production , but still its good if we can catch exception to avoid connect getting abstractedly shutting down. And i see that even if the registration status is failed , its registering the connector configs in the connect specific topics.

So next time i should delete the connect specific topic or create new conenct spefic topics to bring connect framework up.

Exception below

[2017-02-14 13:34:58,870] ERROR Uncaught exception in herder work thread, exiting:  (org.apache.kafka.connect.runtime.distributed.DistributedHerder:183)
org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.cts.peg.iot.connectors.source.tcp.TcpConnector available connectors are: org.apache.kafka.connect.tools.MockConnector, org.apache.kafka.connect.sink.SinkConnector, com.cts.peg.iot.connectors.source.coap.CoapConnector, org.apache.kafka.connect.tools.VerifiableSourceConnector, com.cts.peg.iot.connectors.source.hdfs.HDFSConnector, org.apache.kafka.connect.tools.VerifiableSinkConnector, org.apache.kafka.connect.source.SourceConnector, com.evokly.kafka.connect.mqtt.MqttSourceConnector, org.apache.kafka.connect.tools.MockSourceConnector, com.cts.peg.iot.connectors.sink.s3.S3SinkConnector, org.apache.kafka.connect.tools.MockSinkConnector, org.apache.kafka.connect.file.FileStreamSinkConnector, com.cts.peg.iot.connectors.source.http.HttpConnector, com.cts.peg.iot.connectors.source.ftp.FtpSourceConnector, io.confluent.connect.jdbc.JdbcSourceConnector, com.cts.peg.iot.connectors.sink.elastic.ElasticSinkConnector, org.apache.kafka.connect.file.FileStreamSourceConnector
        at org.apache.kafka.connect.runtime.Worker.getConnectorClass(Worker.java:226)
        at org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:166)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:789)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startWork(DistributedHerder.java:755)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.handleRebalanceCompleted(DistributedHerder.java:715)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:206)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:176)
        at java.lang.Thread.run(Thread.java:745)
[2017-02-14 13:34:58,871] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:68)
[2017-02-14 13:34:58,871] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:154)
[2017-02-14 13:35:58,876] INFO Stopped ServerConnector@1e7aa82b{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:306)
[2017-02-14 13:35:58,880] INFO Stopped o.e.j.s.ServletContextHandler@774698ab{/,null,UNAVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:865)
[2017-02-14 13:36:22,285] WARN  (org.eclipse.jetty.servlet.ServletHandler:620)
javax.servlet.ServletException: A MultiException has 1 exceptions.  They are:
1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1522095831) has been shut down

        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489)
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)
Caused by: A MultiException has 1 exceptions.  They are:
1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1522095831) has been shut down

        at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106)
        at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173)
        at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526)
        at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532)
        at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549)
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319)
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)
        ... 23 more
Caused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1522095831) has been shut down
        at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2288)
        at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:629)
        at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:622)
        at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:640)
        at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103)
        ... 31 more
[2017-02-14 13:36:22,286] WARN /connectors (org.eclipse.jetty.server.HttpChannel:384)
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:684)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)
[2017-02-14 13:36:22,286] WARN Could not send response error 500: java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z (org.eclipse.jetty.server.HttpChannel:482)
[2017-02-14 13:36:22,288] WARN FAILED org.eclipse.jetty.server.Server@6a8dfcb9: java.util.concurrent.TimeoutException (org.eclipse.jetty.util.component.AbstractLifeCycle:212)
java.util.concurrent.TimeoutException
        at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:128)
        at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:30)
        at org.eclipse.jetty.server.Server.doStop(Server.java:426)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
        at org.eclipse.jetty.util.thread.ShutdownThread.run(ShutdownThread.java:138)
[2017-02-14 13:36:22,289] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:165)
[2017-02-14 13:36:22,289] INFO Herder stopping (org.apache.kafka.connect.runtime.distributed.DistributedHerder:362)
[2017-02-14 13:36:22,289] INFO Herder stopped (org.apache.kafka.connect.runtime.distributed.DistributedHerder:382)
[2017-02-14 13:36:22,289] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:73)

Thanks,
Sreejith

Sreejith S

unread,
Feb 21, 2017, 11:54:01 AM2/21/17
to Confluent Platform
Is this issue relevant ? 
Reply all
Reply to author
Forward
0 new messages