ERROR Uncaught exception in herder work thread, exiting:
759 views
Skip to first unread message
sdu...@cardinalcommerce.com
Jan 18, 2018, 4:56:33 PM1/18/18
to Confluent Platform
Hello,
I do not understand what is going on here. Please help.
I am trying to setup SSL on my 3-Broker kafka cluster. I got my kafka brokers listening on SSL (9093) w/o any issues. But, my Kafka Connect is not starting when I add the SSL config to it.
Here is my connect-distributed.properties file:
bootstrap.servers=kafka1:9093,kafka2:9093,kafka3:9093
security.protocol=SSL
ssl.truststore.location=/lib/certs-self/server.truststore.jks
ssl.truststore.password=<password>
group.id=cc-connect-cluster
key.converter=io.confluent.connect.avro.AvroConverter
value.converter=io.confluent.connect.avro.AvroConverter
key.converter.schemas.enable=true
value.converter.schemas.enable=true
internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter
internal.key.converter.schemas.enable=false
internal.value.converter.schemas.enable=false
offset.storage.topic=connect-offsets
offset.storage.replication.factor=3
config.storage.topic=connect-configs
config.storage.replication.factor=3
status.storage.topic=connect-status
status.storage.replication.factor=3
offset.flush.interval.ms=10000
key.converter.schema.registry.url=http://worker1:8081
value.converter.schema.registry.url=http://worker1:8081
consumer.interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringConsumerInterceptor
producer.interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor
format.class=io.confluent.connect.hdfs.avro.AvroFormatand below is the error that I am facing when I try to start my kafka connect:
[2018-01-18 21:41:31,900] INFO Started o.e.j.s.ServletContextHandler@475b7ba{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:744)[2018-01-18 21:41:31,906] INFO Started ServerConnector@4336826f{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:266)[2018-01-18 21:41:31,907] INFO Started @19042ms (org.eclipse.jetty.server.Server:379)[2018-01-18 21:41:31,907] INFO REST server listening at http://172.30.1.21:8083/, advertising URL http://172.30.1.21:8083/ (org.apache.kafka.connect.runtime.rest.RestServer:150)[2018-01-18 21:41:31,908] INFO Kafka Connect started (org.apache.kafka.connect.runtime.Connect:55)[2018-01-18 21:41:41,774] INFO 52.6.13.210 - - [18/Jan/2018:21:41:41 +0000] "GET / HTTP/1.0" 200 54 122 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:41:51,819] INFO 52.6.13.210 - - [18/Jan/2018:21:41:51 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:01,718] INFO 52.6.13.210 - - [18/Jan/2018:21:42:01 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:11,639] INFO 52.6.13.210 - - [18/Jan/2018:21:42:11 +0000] "GET / HTTP/1.0" 200 54 3 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:21,700] INFO 52.6.13.210 - - [18/Jan/2018:21:42:21 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:31,717] INFO 52.6.13.210 - - [18/Jan/2018:21:42:31 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:41,803] INFO 52.6.13.210 - - [18/Jan/2018:21:42:41 +0000] "GET / HTTP/1.0" 200 54 1 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:42:51,622] INFO 52.6.13.210 - - [18/Jan/2018:21:42:51 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:01,634] INFO 52.6.13.210 - - [18/Jan/2018:21:43:01 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:11,845] INFO 52.6.13.210 - - [18/Jan/2018:21:41:41 +0000] "GET /connectors HTTP/1.0" 500 48 90020 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:12,022] INFO 52.6.13.210 - - [18/Jan/2018:21:43:12 +0000] "GET / HTTP/1.0" 200 54 2 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:21,899] INFO 52.6.13.210 - - [18/Jan/2018:21:43:21 +0000] "GET / HTTP/1.0" 200 54 3 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:31,156] ERROR Uncaught exception in herder work thread, exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder:206)org.apache.kafka.connect.errors.ConnectException: Timed out while checking for or creating topic(s) 'connect-offsets'. This could indicate a connectivity issue, unavailable topic partitions, or if this is your first use of the topic it may have taken too long to create. at org.apache.kafka.connect.util.TopicAdmin.createTopics(TopicAdmin.java:241) at org.apache.kafka.connect.storage.KafkaOffsetBackingStore$1.run(KafkaOffsetBackingStore.java:99) at org.apache.kafka.connect.util.KafkaBasedLog.start(KafkaBasedLog.java:126) at org.apache.kafka.connect.storage.KafkaOffsetBackingStore.start(KafkaOffsetBackingStore.java:109) at org.apache.kafka.connect.runtime.Worker.start(Worker.java:146) at org.apache.kafka.connect.runtime.AbstractHerder.startServices(AbstractHerder.java:99) at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:194) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment.[2018-01-18 21:43:31,158] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:65)[2018-01-18 21:43:31,158] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:154)[2018-01-18 21:43:41,952] INFO 52.6.13.210 - - [18/Jan/2018:21:42:11 +0000] "GET /connectors HTTP/1.0" 500 48 90002 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:43:51,776] INFO 52.6.13.210 - - [18/Jan/2018:21:42:21 +0000] "GET /connectors HTTP/1.0" 500 48 90003 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:01,727] INFO 52.6.13.210 - - [18/Jan/2018:21:42:31 +0000] "GET /connectors HTTP/1.0" 500 48 90002 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:11,757] INFO 52.6.13.210 - - [18/Jan/2018:21:42:41 +0000] "GET /connectors HTTP/1.0" 500 48 90003 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:11,888] INFO 52.6.13.210 - - [18/Jan/2018:21:42:41 +0000] "GET /connectors HTTP/1.0" 500 48 90003 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:31,162] INFO Stopped ServerConnector@4336826f{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:306)[2018-01-18 21:44:31,173] INFO Stopped o.e.j.s.ServletContextHandler@475b7ba{/,null,UNAVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:865)[2018-01-18 21:44:31,860] WARN (org.eclipse.jetty.servlet.ServletHandler:620)javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:31,861] INFO 52.6.13.210 - - [1516311781857] "GET /connectors HTTP/1.0" 500 48 90004 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:31,862] WARN /connectors (org.eclipse.jetty.server.HttpChannel:396)javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:130) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) ... 10 moreCaused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:31,863] WARN Could not send response error 500: javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down (org.eclipse.jetty.server.HttpChannel:482)[2018-01-18 21:44:42,077] WARN (org.eclipse.jetty.servlet.ServletHandler:620)javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:42,078] INFO 52.6.13.210 - - [1516311792074] "GET /connectors HTTP/1.0" 500 48 90004 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:42,078] WARN /connectors (org.eclipse.jetty.server.HttpChannel:396)javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:130) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) ... 10 moreCaused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:42,079] WARN Could not send response error 500: javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down (org.eclipse.jetty.server.HttpChannel:482)[2018-01-18 21:44:51,971] WARN (org.eclipse.jetty.servlet.ServletHandler:620)javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:51,972] INFO 52.6.13.210 - - [1516311801968] "GET /connectors HTTP/1.0" 500 48 90004 (org.apache.kafka.connect.runtime.rest.RestServer:60)[2018-01-18 21:44:51,972] WARN /connectors (org.eclipse.jetty.server.HttpChannel:396)javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:130) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:159) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:748)Caused by: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:489) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110) ... 10 moreCaused by: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down
at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:106) at org.jvnet.hk2.internal.FactoryCreator.dispose(FactoryCreator.java:173) at org.jvnet.hk2.internal.SystemDescriptor.dispose(SystemDescriptor.java:526) at org.glassfish.jersey.process.internal.RequestScope$Instance.remove(RequestScope.java:532) at org.glassfish.jersey.process.internal.RequestScope$Instance.release(RequestScope.java:549) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:319) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) ... 23 moreCaused by: java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down at org.jvnet.hk2.internal.ServiceLocatorImpl.checkState(ServiceLocatorImpl.java:2318) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandleImpl(ServiceLocatorImpl.java:630) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:623) at org.jvnet.hk2.internal.ServiceLocatorImpl.getServiceHandle(ServiceLocatorImpl.java:641) at org.jvnet.hk2.internal.FactoryCreator.getFactoryHandle(FactoryCreator.java:103) ... 31 more[2018-01-18 21:44:51,973] WARN Could not send response error 500: javax.servlet.ServletException: javax.servlet.ServletException: A MultiException has 1 exceptions. They are:1. java.lang.IllegalStateException: ServiceLocatorImpl(__HK2_Generated_0,1,1283299226) has been shut down (org.eclipse.jetty.server.HttpChannel:482)[2018-01-18 21:44:51,974] WARN FAILED org.eclipse.jetty.server.Server@36077f7e: java.util.concurrent.TimeoutException (org.eclipse.jetty.util.component.AbstractLifeCycle:212)java.util.concurrent.TimeoutException at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:128) at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:30) at org.eclipse.jetty.server.Server.doStop(Server.java:426) at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89) at org.eclipse.jetty.util.thread.ShutdownThread.run(ShutdownThread.java:138)[2018-01-18 21:44:51,974] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:165)[2018-01-18 21:44:51,974] INFO Herder stopping (org.apache.kafka.connect.runtime.distributed.DistributedHerder:377)[2018-01-18 21:44:56,975] INFO Herder stopped (org.apache.kafka.connect.runtime.distributed.DistributedHerder:397)[2018-01-18 21:44:56,975] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:70)
I do not understand what is going on here. Please help.
Thank you.
Reply all
Reply to author
Forward
0 new messages