Confluent 3 | Error when starting control center

4,511 views
Skip to first unread message

Vadim Dzyuban

unread,
Jul 20, 2016, 1:41:14 PM7/20/16
to Confluent Platform
I installed confluent 3 on centos 7 + java 8, followed the instructions at http://docs.confluent.io/3.0.0/control-center/docs/quickstart.html
Successfully started zookeeper, kafka, schema registry, kafka connect, but starting control center gives an error:
./bin/control-center-start /tmp/control-center.properties
Error: Could not find or load main class kafka.admin.TopicCommand
Creating topic _confluent-monitoring with 1 partitions and replication factor of 1...Error: Could not find or load main class kafka.admin.TopicCommand
Any help will be appreciated
Thanks 
Vadim Dzyuban

Roger Hoover

unread,
Jul 20, 2016, 4:32:23 PM7/20/16
to confluent...@googlegroups.com
Hi Vadim,

That seems to be a bug in the way the script finds it's own directory.  I'll file a JIRA for that.  In the mean, you can work around it by running the start script from it's absolute path.

/usr/bin/control-center-start /tmp/control-center.properties


--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6d0b1575-5796-4ad8-ace5-a490a35391a9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Vadim Dzyuban

unread,
Jul 21, 2016, 6:09:53 PM7/21/16
to Confluent Platform
Thank you very much Roger for quick response!

I was able to start the control center as you advised and proceeded further until step 11 on http://docs.confluent.io/3.0.0/control-center/docs/quickstart.html

Unfortunately I was NOT ABLE TO RUN CONTROL CENTER WEB UI ON PORT 9021 according to the instructions.
I got "The site can't be reached, refused to connect" on the browser.

Here are some details and I would appreciate for any help or idea why it is not working 

(1)"wget" on port 9021 refused to connect:
--2016-07-21 21:49:51--  http://127.0.0.1:9021/
Connecting to 127.0.0.1:9021... failed: Connection refused.

(2)"wget" on port 8083 is ok:
--2016-07-21 22:03:23--  http://127.0.0.1:8083/
Connecting to 127.0.0.1:8083... connected.
HTTP request sent, awaiting response... 200 OK
Length: 54 [application/json]
Saving to: ‘index.html.3’
100%[==================================================================================================================================================================>] 54          --.-K/s   in 0s
2016-07-21 22:03:23 (8.25 MB/s) - ‘index.html.3’ saved [54/54]

(3)console output when starting control center looks ok:
./usr/bin/control-center-start /tmp/control-center.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/share/java/confluent-common/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/java/confluent-control-center/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Internal topics already exist. OK.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/share/java/confluent-common/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/java/confluent-control-center/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
[2016-07-21 21:27:02,949] INFO ControlCenterConfig values:
        confluent.controlcenter.internal.topics.replication = 1
        compression.type = lz4
        metric.reporters = []
        ssl.client.auth = false
        bootstrap.servers = [localhost:9092]
        response.mediatype.default = application/json
        confluent.controlcenter.data.dir = /tmp/confluent/control-center
        retry.backoff.ms = 100
        ssl.keystore.type = JKS
        ssl.trustmanager.algorithm =
        metrics.jmx.prefix = confluent.controlcenter
        confluent.controlcenter.name = _confluent-controlcenter
        request.logger.name = io.confluent.rest-utils.requests
        confluent.controlcenter.license =
        ssl.key.password =
        confluent.controlcenter.connect.cluster = localhost:8083
        ssl.truststore.password =
        session.timeout.ms = 275000
        metrics.num.samples = 2
        ssl.endpoint.identification.algorithm =
        ssl.protocol = TLS
        debug = false
        listeners = []
        max.poll.records = 11
        request.timeout.ms = 285000
        ssl.provider =
        ssl.enabled.protocols = []
        shutdown.graceful.ms = 1000
        ssl.keystore.location =
        response.mediatype.preferred = [application/json]
        confluent.monitoring.interceptor.topic = _confluent-monitoring
        ssl.cipher.suites = []
        ssl.truststore.type = JKS
        retries = 2147483647
        access.control.allow.methods = GET,OPTIONS,HEAD,POST,PUT,DELETE
        access.control.allow.origin = *
        ssl.truststore.location =
        ssl.keystore.password =
        ssl.keymanager.algorithm =
        zookeeper.connect = localhost:2181
        port = 9021
        metrics.sample.window.ms = 30000
        confluent.controlcenter.streams.threads = 2
 (io.confluent.controlcenter.ControlCenterConfig:135)
[2016-07-21 21:27:04,559] WARN file=dist/index.html length=311 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-21 21:27:04,705] WARN file=dist/app.js length=1811321 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-21 21:27:04,714] WARN file=dist/app.css length=167621 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-21 21:27:05,182] WARN checking license failure: Unable to process JOSE object (cause: org.jose4j.lang.JoseException: Invalid JOSE Compact Serialization. Expecting either 3 or 5 parts for JWS or JWE respectively but was 1.):  (io.confluent.license.LicenseModule:39)

(4)zookeeper is working ok
ps aux | grep zookeeper
root      1290  0.2  0.3 4470088 90184 ?       Sl+  21:24   0:04 java -Xmx512M -Xms512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/var/log/kafka/zookeeper-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/etc/kafka/log4j.properties -cp :/bin/../share/java/kafka/*:/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/* org.apache.zookeeper.server.quorum.QuorumPeerMain ./etc/kafka/zookeeper.properties
root      1769  0.0  0.0  10644   976 ?        S+   21:54   0:00 grep --color=auto zookeeper

(5)kafka is working ok
 ps aux | grep kafka
root       278  101  1.7 5617176 429140 ?      Sl+  21:02  52:16 java -Xmx256M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/etc/kafka/connect-log4j.properties -cp :./bin/../share/java/confluent-common/*:./bin/../share/java/kafka-serde-tools/*:./bin/../share/java/monitoring-interceptors/*:./bin/../share/java/kafka-connect-hdfs/*:./bin/../share/java/kafka-connect-jdbc/*:/bin/../share/java/kafka/*:/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/* org.apache.kafka.connect.cli.ConnectDistributed /tmp/connect-distributed.properties
root      1290  0.2  0.3 4470088 90184 ?       Sl+  21:24   0:04 java -Xmx512M -Xms512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/var/log/kafka/zookeeper-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/etc/kafka/log4j.properties -cp :/bin/../share/java/kafka/*:/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/* org.apache.zookeeper.server.quorum.QuorumPeerMain ./etc/kafka/zookeeper.properties
root      1330  2.7  3.2 7726684 789096 ?      Sl+  21:25   0:47 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/var/log/kafka/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/etc/kafka/log4j.properties -cp :/bin/../share/java/kafka/*:/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/* io.confluent.support.metrics.SupportedKafka ./etc/kafka/server.properties
root      1406  0.8  0.9 5350040 243860 ?      Sl+  21:25   0:15 java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dlog4j.configuration=file:/etc/schema-registry/log4j.properties -cp :/bin/../package-schema-registry/target/kafka-schema-registry-package-*-development/share/java/schema-registry/*:/bin/../share/java/confluent-common/*:/bin/../share/java/rest-utils/*:/bin/../share/java/schema-registry/* io.confluent.kafka.schemaregistry.rest.SchemaRegistryMain ./etc/schema-registry/schema-registry.properties
root      1464  101  1.7 5350920 425176 ?      Sl+  21:26  28:52 java -Xmx256M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/var/log/kafka -Dlog4j.configuration=file:/etc/kafka/connect-log4j.properties -cp :./bin/../share/java/confluent-common/*:./bin/../share/java/kafka-serde-tools/*:./bin/../share/java/monitoring-interceptors/*:./bin/../share/java/kafka-connect-hdfs/*:./bin/../share/java/kafka-connect-jdbc/*:/bin/../share/java/kafka/*:/bin/../share/java/confluent-support-metrics/*:/usr/share/java/confluent-support-metrics/* org.apache.kafka.connect.cli.ConnectDistributed /tmp/connect-distributed.properties
root      1771  0.0  0.0  10644   972 ?        R+   21:54   0:00 grep --color=auto kafka


On Wednesday, July 20, 2016 at 4:32:23 PM UTC-4, Roger Hoover wrote:
Hi Vadim,

That seems to be a bug in the way the script finds it's own directory.  I'll file a JIRA for that.  In the mean, you can work around it by running the start script from it's absolute path.

/usr/bin/control-center-start /tmp/control-center.properties

On Wed, Jul 20, 2016 at 10:41 AM, Vadim Dzyuban <vadim....@gmail.com> wrote:
I installed confluent 3 on centos 7 + java 8, followed the instructions at http://docs.confluent.io/3.0.0/control-center/docs/quickstart.html
Successfully started zookeeper, kafka, schema registry, kafka connect, but starting control center gives an error:
./bin/control-center-start /tmp/control-center.properties
Error: Could not find or load main class kafka.admin.TopicCommand
Creating topic _confluent-monitoring with 1 partitions and replication factor of 1...Error: Could not find or load main class kafka.admin.TopicCommand
Any help will be appreciated
Thanks 
Vadim Dzyuban

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

Jonathan Apodaca

unread,
Jul 22, 2016, 11:50:46 AM7/22/16
to Confluent Platform
I can confirm this behavior.  I have two scenarios, one which works (in a broken way) and another which does not work:

Scenario one:
1) Start Zookeeper
2) Start Kafka
3) Start Schema Registry
4) Start Control Center

This "works" in that control center will start up and I can access it on port 9021.  However, you will notice that I did not start Kafka Connect.

Scenario two:

1) Start Zookeeper
2) Start Kafka
3) Start Schema Registry
4) Start Kafka Connect
5) Start Control Center <-- this one hangs at the following log:

~# tail -f /var/log/control-center.log
[2016-07-22 15:41:16,566] WARN file=dist/index.html length=311 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-22 15:41:16,767] WARN file=dist/app.js length=1836368 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-22 15:41:16,775] WARN file=dist/app.css length=167621 (io.confluent.controlcenter.rest.StaticFileResource:77)
[2016-07-22 15:41:17,097] WARN checking license failure: Unable to process JOSE object (cause: org.jose4j.lang.JoseException: Invalid JOSE Compact Serialization. Expecting either 3 or 5 parts for JWS or JWE respectively but was 1.):  (io.confluent.license.LicenseModule:39)


And it never moves on from there.  To be clear, when I dont' start Kafka Connect, I still see the above log error, but Control Center moves on from that and starts the server.

Interestingly, when I view the kafka-connect log, I see some interesting warnings:

[2016-07-22 15:40:04,311] WARN The configuration producer.interceptor.classes = io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration config.storage.topic = connect-configs was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration status.storage.topic = connect-statuses was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration internal.key.converter.schemas.enable = false was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration value.converter.schema.registry.url = http://localhost:8081 was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration internal.key.converter = org.apache.kafka.connect.json.JsonConverter was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration internal.value.converter.schemas.enable = false was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration consumer.interceptor.classes = io.confluent.monitoring.clients.interceptor.MonitoringConsumerInterceptor was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration internal.value.converter = org.apache.kafka.connect.json.JsonConverter was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration offset.storage.topic = connect-offsets was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration value.converter = io.confluent.connect.avro.AvroConverter was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration key.converter = io.confluent.connect.avro.AvroConverter was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)
[2016-07-22 15:40:04,311] WARN The configuration key.converter.schema.registry.url = http://localhost:8081 was supplied but isn'
t a known config. (org.apache.kafka.clients.consumer.ConsumerConfig:186)

Vadim Dzyuban

unread,
Jul 22, 2016, 2:52:00 PM7/22/16
to Confluent Platform
Thank you very much Jonathan for sharing your experience and help.
Interesting, this part of confluent 3 is a commercial product.
Is this misbehavior in free trial version only ?
Anybody ran into the same issue and may be fixed it somehow, please share your experience.

Jonathan Apodaca

unread,
Jul 22, 2016, 4:19:35 PM7/22/16
to Confluent Platform
Yeah, it runs under a month free trial.  Only trouble is I can't actually test it out b/c the trial doesn't seem to work.  Anybody have any solutions for us?

Roger Hoover

unread,
Jul 22, 2016, 6:43:05 PM7/22/16
to confluent...@googlegroups.com
Hi Vadim and Jonathan,

Sorry that you're running into this trouble.  Control Center seems to be getting blocked on something before it can start up.  I don't think it has to do with the license check.  It looks like that just happens to be the last thing that was logged before it got stuck.

Would you guys mind posting a thread dump?

$ jps | grep ControlCenter
9118 ControlCenter

$ jstack -l 9118






To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Jonathan Apodaca

unread,
Jul 25, 2016, 10:31:09 AM7/25/16
to Confluent Platform
Hi Rodger,

The output of those commands in my environment are:

root@1b089dc4b52b:/var/log# jps -l
1602 jdk.jcmd/sun.tools.jps.Jps
117 io.confluent.kafka.schemaregistry.rest.SchemaRegistryMain
182 io.confluent.controlcenter.ControlCenter
9 org.apache.zookeeper.server.quorum.QuorumPeerMain
173 org.apache.kafka.connect.cli.ConnectDistributed
46 io.confluent.support.metrics.SupportedKafka
root@1b089dc4b52b:/var/log# jstack 182
2016-07-23 01:46:52
Full thread dump OpenJDK 64-Bit Server VM (25.91-b14 mixed mode):

"Attach Listener" #26 daemon prio=9 os_prio=0 tid=0x00007f1268001000 nid=0x674 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"main-EventThread" #25 daemon prio=5 os_prio=0 tid=0x00007f12a4d22000 nid=0x541 waiting on condition [0x00007f1252263000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d56e1d40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

"main-SendThread(localhost:2181)" #24 daemon prio=5 os_prio=0 tid=0x00007f12a4d20000 nid=0x540 runnable [0x00007f1252364000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d56e1d88> (a sun.nio.ch.Util$2)
- locked <0x00000000d56e1da0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d55fddb0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

"ZkClient-EventThread-23-localhost:2181" #23 daemon prio=5 os_prio=0 tid=0x00007f12a4d06000 nid=0x53f waiting on condition [0x00007f1252465000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d56e1db8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

"main-EventThread" #21 daemon prio=5 os_prio=0 tid=0x00007f12a4c14000 nid=0x53e waiting on condition [0x00007f1252566000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51bdb20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

"main-SendThread(localhost:2181)" #20 daemon prio=5 os_prio=0 tid=0x00007f12a4bac000 nid=0x53d runnable [0x00007f1252667000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51bde38> (a sun.nio.ch.Util$2)
- locked <0x00000000d51bde20> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190108> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

"ZkClient-EventThread-19-localhost:2181" #19 daemon prio=5 os_prio=0 tid=0x00007f12a4baa800 nid=0x53c waiting on condition [0x00007f1252768000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51bdf28> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-2-producer" #18 daemon prio=5 os_prio=0 tid=0x00007f12a4ba8000 nid=0x53b runnable [0x00007f1252869000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51be2b8> (a sun.nio.ch.Util$2)
- locked <0x00000000d51be2a0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190198> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.kafka.common.network.Selector.select(Selector.java:454)
at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
at java.lang.Thread.run(Thread.java:745)

"main-EventThread" #16 daemon prio=5 os_prio=0 tid=0x00007f12a4b66000 nid=0x53a waiting on condition [0x00007f1252b6a000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51c0238> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

"main-SendThread(localhost:2181)" #15 daemon prio=5 os_prio=0 tid=0x00007f12a4b67800 nid=0x539 runnable [0x00007f1252c6b000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51c0568> (a sun.nio.ch.Util$2)
- locked <0x00000000d51c0550> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190270> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

"ZkClient-EventThread-14-localhost:2181" #14 daemon prio=5 os_prio=0 tid=0x00007f12a4b60800 nid=0x538 waiting on condition [0x00007f1252d6c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51c0688> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-1-producer" #13 daemon prio=5 os_prio=0 tid=0x00007f12a4b1e800 nid=0x537 runnable [0x00007f1252e6d000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51c0a18> (a sun.nio.ch.Util$2)
- locked <0x00000000d51c0a00> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190300> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.kafka.common.network.Selector.select(Selector.java:454)
at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
at java.lang.Thread.run(Thread.java:745)

"RMI TCP Accept-0" #11 daemon prio=5 os_prio=0 tid=0x00007f12a4707000 nid=0x535 runnable [0x00007f1253a69000]
   java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
at java.lang.Thread.run(Thread.java:745)

"Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007f12a4102800 nid=0x534 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007f12a40f7800 nid=0x533 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f12a40f3000 nid=0x532 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f12a40f0800 nid=0x531 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007f12a40ee800 nid=0x530 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0 tid=0x00007f12a40ec800 nid=0x52f waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f12a40c6800 nid=0x52e in Object.wait() [0x00007f128c2fb000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000d4fd9430> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00000000d4fd9430> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f12a40c1800 nid=0x52d in Object.wait() [0x00007f128c3fc000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000d4faccc0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
- locked <0x00000000d4faccc0> (a java.lang.ref.Reference$Lock)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"main" #1 prio=5 os_prio=0 tid=0x00007f12a400e800 nid=0x526 runnable [0x00007f12aae19000]
   java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
- locked <0x00000000c199f9a0> (a java.io.BufferedInputStream)
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536)
- locked <0x00000000c19a7f48> (a sun.net.www.protocol.http.HttpURLConnection)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
- locked <0x00000000c19a7f48> (a sun.net.www.protocol.http.HttpURLConnection)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
at org.glassfish.jersey.client.HttpUrlConnector._apply(HttpUrlConnector.java:335)
at org.glassfish.jersey.client.HttpUrlConnector.apply(HttpUrlConnector.java:242)
at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:254)
at org.glassfish.jersey.client.JerseyInvocation$3.call(JerseyInvocation.java:709)
at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
at org.glassfish.jersey.internal.Errors.process(Errors.java:228)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444)
at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:705)
at io.confluent.controlcenter.connect.ConnectService.getConnectorPlugins(ConnectService.java:83)
at io.confluent.controlcenter.connect.ConnectService.<init>(ConnectService.java:48)
at io.confluent.controlcenter.connect.ConnectService$$FastClassByGuice$$89f5f123.newInstance(<generated>)
at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:61)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103)
at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145)
at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:104)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:104)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1016)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1012)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1051)
at io.confluent.controlcenter.ControlCenter.main(ControlCenter.java:58)

"VM Thread" os_prio=0 tid=0x00007f12a40ba000 nid=0x52c runnable

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4020000 nid=0x527 runnable

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4021800 nid=0x528 runnable

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4023000 nid=0x529 runnable

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4025000 nid=0x52a runnable

"Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007f12a4067800 nid=0x52b runnable

"VM Periodic Task Thread" os_prio=0 tid=0x00007f12a471c800 nid=0x536 waiting on condition

JNI global references: 280

root@1b089dc4b52b:/var/log# jstack -l 182
2016-07-23 01:48:22
Full thread dump OpenJDK 64-Bit Server VM (25.91-b14 mixed mode):

"Attach Listener" #26 daemon prio=9 os_prio=0 tid=0x00007f1268001000 nid=0x674 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"main-EventThread" #25 daemon prio=5 os_prio=0 tid=0x00007f12a4d22000 nid=0x541 waiting on condition [0x00007f1252263000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d56e1d40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
- None

"main-SendThread(localhost:2181)" #24 daemon prio=5 os_prio=0 tid=0x00007f12a4d20000 nid=0x540 runnable [0x00007f1252364000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d56e1d88> (a sun.nio.ch.Util$2)
- locked <0x00000000d56e1da0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d55fddb0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
- None

"ZkClient-EventThread-23-localhost:2181" #23 daemon prio=5 os_prio=0 tid=0x00007f12a4d06000 nid=0x53f waiting on condition [0x00007f1252465000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d56e1db8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
- None

"main-EventThread" #21 daemon prio=5 os_prio=0 tid=0x00007f12a4c14000 nid=0x53e waiting on condition [0x00007f1252566000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51bdb20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
- None

"main-SendThread(localhost:2181)" #20 daemon prio=5 os_prio=0 tid=0x00007f12a4bac000 nid=0x53d runnable [0x00007f1252667000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51bde38> (a sun.nio.ch.Util$2)
- locked <0x00000000d51bde20> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190108> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
- None

"ZkClient-EventThread-19-localhost:2181" #19 daemon prio=5 os_prio=0 tid=0x00007f12a4baa800 nid=0x53c waiting on condition [0x00007f1252768000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51bdf28> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
- None

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-2-producer" #18 daemon prio=5 os_prio=0 tid=0x00007f12a4ba8000 nid=0x53b runnable [0x00007f1252869000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51be2b8> (a sun.nio.ch.Util$2)
- locked <0x00000000d51be2a0> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190198> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.kafka.common.network.Selector.select(Selector.java:454)
at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
- None

"main-EventThread" #16 daemon prio=5 os_prio=0 tid=0x00007f12a4b66000 nid=0x53a waiting on condition [0x00007f1252b6a000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51c0238> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
- None

"main-SendThread(localhost:2181)" #15 daemon prio=5 os_prio=0 tid=0x00007f12a4b67800 nid=0x539 runnable [0x00007f1252c6b000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51c0568> (a sun.nio.ch.Util$2)
- locked <0x00000000d51c0550> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190270> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
- None

"ZkClient-EventThread-14-localhost:2181" #14 daemon prio=5 os_prio=0 tid=0x00007f12a4b60800 nid=0x538 waiting on condition [0x00007f1252d6c000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0x00000000d51c0688> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
- None

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-1-producer" #13 daemon prio=5 os_prio=0 tid=0x00007f12a4b1e800 nid=0x537 runnable [0x00007f1252e6d000]
   java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- locked <0x00000000d51c0a18> (a sun.nio.ch.Util$2)
- locked <0x00000000d51c0a00> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000d5190300> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.apache.kafka.common.network.Selector.select(Selector.java:454)
at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
- None

"RMI TCP Accept-0" #11 daemon prio=5 os_prio=0 tid=0x00007f12a4707000 nid=0x535 runnable [0x00007f1253a69000]
   java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
- None

"Service Thread" #9 daemon prio=9 os_prio=0 tid=0x00007f12a4102800 nid=0x534 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"C1 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007f12a40f7800 nid=0x533 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f12a40f3000 nid=0x532 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f12a40f0800 nid=0x531 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007f12a40ee800 nid=0x530 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0 tid=0x00007f12a40ec800 nid=0x52f waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
- None

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f12a40c6800 nid=0x52e in Object.wait() [0x00007f128c2fb000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000d4fd9430> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
- locked <0x00000000d4fd9430> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

   Locked ownable synchronizers:
- None

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f12a40c1800 nid=0x52d in Object.wait() [0x00007f128c3fc000]
   java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000d4faccc0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
- locked <0x00000000d4faccc0> (a java.lang.ref.Reference$Lock)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

   Locked ownable synchronizers:
- None

"main" #1 prio=5 os_prio=0 tid=0x00007f12a400e800 nid=0x526 runnable [0x00007f12aae19000]
   java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
- locked <0x00000000c199f9a0> (a java.io.BufferedInputStream)
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536)
- locked <0x00000000c19a7f48> (a sun.net.www.protocol.http.HttpURLConnection)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
- locked <0x00000000c19a7f48> (a sun.net.www.protocol.http.HttpURLConnection)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
at org.glassfish.jersey.client.HttpUrlConnector._apply(HttpUrlConnector.java:335)
at org.glassfish.jersey.client.HttpUrlConnector.apply(HttpUrlConnector.java:242)
at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:254)
at org.glassfish.jersey.client.JerseyInvocation$3.call(JerseyInvocation.java:709)
at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
at org.glassfish.jersey.internal.Errors.process(Errors.java:228)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444)
at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:705)
at io.confluent.controlcenter.connect.ConnectService.getConnectorPlugins(ConnectService.java:83)
at io.confluent.controlcenter.connect.ConnectService.<init>(ConnectService.java:48)
at io.confluent.controlcenter.connect.ConnectService$$FastClassByGuice$$89f5f123.newInstance(<generated>)
at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:61)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103)
at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145)
at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:104)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:38)
at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:62)
at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:104)
at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1016)
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1012)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1051)
at io.confluent.controlcenter.ControlCenter.main(ControlCenter.java:58)

   Locked ownable synchronizers:
- <0x00000000d51eec50> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"VM Thread" os_prio=0 tid=0x00007f12a40ba000 nid=0x52c runnable

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4020000 nid=0x527 runnable

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4021800 nid=0x528 runnable

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4023000 nid=0x529 runnable

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007f12a4025000 nid=0x52a runnable

"Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007f12a4067800 nid=0x52b runnable

"VM Periodic Task Thread" os_prio=0 tid=0x00007f12a471c800 nid=0x536 waiting on condition

JNI global references: 281

root@1b089dc4b52b:/var/log#
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Vadim Dzyuban

unread,
Jul 25, 2016, 11:46:24 AM7/25/16
to Confluent Platform
Hi Roger,
Below are the outputs and thank you very much for your help:

[root@5ed6fd88f520 /]# jps | grep ControlCenter
366 ControlCenter
[root@5ed6fd88f520 /]#

[root@5ed6fd88f520 /]# jstack -l 366
2016-07-25 15:42:48
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.91-b14 mixed mode):

"Attach Listener" #27 daemon prio=9 os_prio=0 tid=0x00007fb950001000 nid=0x9ee waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"main-EventThread" #26 daemon prio=5 os_prio=0 tid=0x00007fb9a8da1800 nid=0x22d waiting on condition [0x00007fb93a05c000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000c64b56c0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
        - None

"main-SendThread(localhost:2181)" #25 daemon prio=5 os_prio=0 tid=0x00007fb9a8d9f800 nid=0x22c runnable [0x00007fb93a15d000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000c651aca8> (a sun.nio.ch.Util$2)
        - locked <0x00000000c651ac98> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000c651ac50> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
        - None

"ZkClient-EventThread-24-localhost:2181" #24 daemon prio=5 os_prio=0 tid=0x00007fb9a8d85800 nid=0x22b waiting on condition [0x00007fb93a25e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000c64b58c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
        - None

"main-EventThread" #22 daemon prio=5 os_prio=0 tid=0x00007fb9a8c97000 nid=0x22a waiting on condition [0x00007fb93a35f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000d5579f08> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
        - None

"main-SendThread(localhost:2181)" #21 daemon prio=5 os_prio=0 tid=0x00007fb9a8c95800 nid=0x229 runnable [0x00007fb93a460000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000d5579ea8> (a sun.nio.ch.Util$2)
        - locked <0x00000000d5579e90> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000d55b3fa0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
        - None

"ZkClient-EventThread-20-localhost:2181" #20 daemon prio=5 os_prio=0 tid=0x00007fb9a8c7a800 nid=0x228 waiting on condition [0x00007fb93a561000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000d55c9448> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
        - None

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-2-producer" #19 daemon prio=5 os_prio=0 tid=0x00007fb9a8c60800 nid=0x227 runnable [0x00007fb93a662000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000d5579ec0> (a sun.nio.ch.Util$2)
        - locked <0x00000000d5579ed8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000d55b4030> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.kafka.common.network.Selector.select(Selector.java:454)
        at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
        at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
        - None

"main-EventThread" #17 daemon prio=5 os_prio=0 tid=0x00007fb9a8bf5000 nid=0x226 waiting on condition [0x00007fb93a963000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000d55c9490> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:493)

   Locked ownable synchronizers:
        - None

"main-SendThread(localhost:2181)" #16 daemon prio=5 os_prio=0 tid=0x00007fb9a8bf6800 nid=0x225 runnable [0x00007fb93aa64000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000d55c94d8> (a sun.nio.ch.Util$2)
        - locked <0x00000000d564b278> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000d55d0038> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:274)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)

   Locked ownable synchronizers:
        - None

"ZkClient-EventThread-15-localhost:2181" #15 daemon prio=5 os_prio=0 tid=0x00007fb9a8bdf000 nid=0x224 waiting on condition [0x00007fb93ab65000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000d5579e78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:67)

   Locked ownable synchronizers:
        - None

"kafka-producer-network-thread | _confluent-controlcenter-0-1-StreamThread-1-producer" #14 daemon prio=5 os_prio=0 tid=0x00007fb9a8b95800 nid=0x223 runnable [0x00007fb93ac66000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000d564b548> (a sun.nio.ch.Util$2)
        - locked <0x00000000d564b560> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000d55b40c0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.kafka.common.network.Selector.select(Selector.java:454)
        at org.apache.kafka.common.network.Selector.poll(Selector.java:277)
        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:260)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:229)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134)
        at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-0" #12 daemon prio=5 os_prio=0 tid=0x00007fb9a8754000 nid=0x221 runnable [0x00007fb93bf9d000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:745)

   Locked ownable synchronizers:
        - None

"Service Thread" #10 daemon prio=9 os_prio=0 tid=0x00007fb9a813b800 nid=0x220 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C1 CompilerThread3" #9 daemon prio=9 os_prio=0 tid=0x00007fb9a8138000 nid=0x21f waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007fb9a8136000 nid=0x21e waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007fb9a8133800 nid=0x21d waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007fb9a8131800 nid=0x21c waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007fb9a812f800 nid=0x21b runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0 tid=0x00007fb9a812e000 nid=0x21a waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fb9a80fb000 nid=0x219 in Object.wait() [0x00007fb978252000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000d564b290> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000d564b290> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

   Locked ownable synchronizers:
        - None

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fb9a80f6800 nid=0x218 in Object.wait() [0x00007fb978353000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000d564b5a8> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000000d564b5a8> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

   Locked ownable synchronizers:
        - None

"main" #1 prio=5 os_prio=0 tid=0x00007fb9a800c800 nid=0x20b runnable [0x00007fb9af6d0000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
        - locked <0x00000000c651cdc8> (a java.io.BufferedInputStream)
        at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1536)
        - locked <0x00000000c651ce78> (a sun.net.www.protocol.http.HttpURLConnection)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
        - locked <0x00000000c651ce78> (a sun.net.www.protocol.http.HttpURLConnection)
        - <0x00000000d589c630> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)

"VM Thread" os_prio=0 tid=0x00007fb9a80ee800 nid=0x217 runnable

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a801d800 nid=0x20c runnable

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a801f800 nid=0x20d runnable

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a8021000 nid=0x20e runnable

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a8023000 nid=0x20f runnable

"Gang worker#4 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a8025000 nid=0x210 runnable

"Gang worker#5 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a8026800 nid=0x211 runnable

"Gang worker#6 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a8028800 nid=0x212 runnable

"Gang worker#7 (Parallel GC Threads)" os_prio=0 tid=0x00007fb9a802a000 nid=0x213 runnable

"Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007fb9a809b800 nid=0x216 runnable

"Gang worker#0 (Parallel CMS Threads)" os_prio=0 tid=0x00007fb9a8097800 nid=0x214 runnable

"Gang worker#1 (Parallel CMS Threads)" os_prio=0 tid=0x00007fb9a8099800 nid=0x215 runnable

"VM Periodic Task Thread" os_prio=0 tid=0x00007fb9a876b000 nid=0x222 waiting on condition

JNI global references: 278

[root@5ed6fd88f520 /]#

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Jonathan Apodaca

unread,
Jul 25, 2016, 1:10:52 PM7/25/16
to Confluent Platform
Vadmi, it would appear that we are both running in a Docker container?  I wonder if there is a problem with confluent within Docker?

My Dockerfile:
FROM ubuntu

RUN apt-get update && \
apt-get install -y openjdk-8-jdk-headless vim && \
apt-get clean

ADD files/confluent-3.0.0-2.11.tar /opt

ADD files/entry.sh /
ENTRYPOINT /entry.sh

(note that previously I had just the JRE [not JDK] installed; but only the JDK comes with jstack, apparently)

My entry.sh:
#!/bin/bash

echo Starting up Zookeeper
/opt/confluent-3.0.0/bin/zookeeper-server-start /opt/confluent-3.0.0/etc/kafka/zookeeper.properties 2>&1 > /var/log/zookeeper.log &
while [ ! -f /var/log/zookeeper.log ]; do sleep 1; done
tail -f /var/log/zookeeper.log | while read LINE
do
[[ "${LINE}" == *"binding to port"* ]] && pkill -P $$ tail
done

echo Starting up Kafka
/opt/confluent-3.0.0/bin/kafka-server-start /opt/confluent-3.0.0/etc/kafka/server.properties 2>&1 > /var/log/kafka.log &
while [ ! -f /var/log/kafka.log ]; do sleep 1; done
tail -f /var/log/kafka.log | while read LINE
do
[[ "${LINE}" == *"Monitored broker is now ready"* ]] && pkill -P $$ tail
done

echo Starting up Schema Registry
/opt/confluent-3.0.0/bin/schema-registry-start /opt/confluent-3.0.0/etc/schema-registry/schema-registry.properties 2>&1 > /var/log/schema-registry.log &

echo Starting up Kafka Connect
cp /opt/confluent-3.0.0/etc/schema-registry/connect-avro-distributed.properties /tmp/connect-distributed.properties
echo "" >> /tmp/connect-distributed.properties
cat <<EOF >> /tmp/connect-distributed.properties
consumer.interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringConsumerInterceptor
producer.interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor
EOF
/opt/confluent-3.0.0/bin/connect-distributed /tmp/connect-distributed.properties 2>&1 > /var/log/kafka-connect.log &

echo Starting up Control Center
cp /opt/confluent-3.0.0/etc/confluent-control-center/control-center.properties /tmp/control-center.properties
cat <<EOF >> /tmp/control-center.properties
confluent.controlcenter.internal.topics.partitions=1
confluent.controlcenter.internal.topics.replication=1
confluent.monitoring.interceptor.topic.partitions=1
confluent.monitoring.interceptor.topic.replication=1
EOF
/opt/confluent-3.0.0/bin/control-center-start /tmp/control-center.properties 2>&1 > /var/log/control-center.log &

echo Startup complete

bash


After running the container, I tail the control center log, to watch it freeze on the line previously mentioned:
tail -f /var/log/control-center.log

Roger Hoover

unread,
Jul 25, 2016, 2:29:37 PM7/25/16
to confluent...@googlegroups.com
Hi Vadim and Jonathan,

Thank you for the stack dumps.  They show that Control Center is blocked during it's startup trying to query the list of connectors from Kafka Connect.  I was able to reproduce this myself on a Centos 7 VM and a call to the Connect REST API "curl localhost:8083/connector-plugins" blocks indefinitely.

I don't know yet what the issue is the Kafka Connect getting stuck but you may be able to work around this with Control Center, at least, by launching Control Center before Connect.  That should allow Control Center to complete it's start up.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Jonathan Apodaca

unread,
Jul 25, 2016, 3:17:29 PM7/25/16
to Confluent Platform
Awesome, thanks Roger; that seems to do the trick; of note however, I seem to have to wait for Control Center to complete its startup before I start Kafka Connect.  Just thought I'd mention that for anybody else who might read this.
-Jonathan
...

Vadim Dzyuban

unread,
Jul 25, 2016, 3:21:30 PM7/25/16
to Confluent Platform
Jonathan,
I'm running docker container. I used CentOS 7 as the base image, than installed java 8 jdk and confluent 3.
The goal was to evaluate the ControlCenter for kafka monitoring.
I did not have any problem with confluent 3 installation, was able to successfully create kafka topics, produce and consume messages on the console.
And you are right, jps and jstack commands are part of the jdk.
Thank you for sharing your thoughts.
Message has been deleted
Message has been deleted

Vadim Dzyuban

unread,
Jul 25, 2016, 3:57:45 PM7/25/16
to Confluent Platform
Jonathan,
I was able to access the  control center web ui,but got nothing under the topics and consumer groups links, just blank space.
Have you seen the list of topics and consumer groups ?
Thanks.

Roger Hoover

unread,
Jul 25, 2016, 4:37:59 PM7/25/16
to confluent...@googlegroups.com
Hi Vadim,

Data has to be both produced and consumed before it shows up in the UI.  Here's a test script that I run to see things show up.

control-center-run-class kafka.admin.TopicCommand --create --topic test-topic --partitions 1 --replication-factor 1 --if-not-exists --zookeeper "$ZOOKEEPER_CONNECT" 
echo "interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor" > /tmp/producer.config
echo "acks=all" >> /tmp/producer.config
seq 10000 > /tmp/msgs
control-center-run-class kafka.tools.ConsoleProducer --broker-list "$BOOTSTRAP_SERVERS" --topic test-topic --producer.config /tmp/producer.config < /tmp/msgs

echo "interceptor.classes=io.confluent.monitoring.clients.interceptor.MonitoringConsumerInterceptor" > /tmp/consumer.config
control-center-run-class kafka.tools.ConsoleConsumer --bootstrap-server "$BOOTSTRAP_SERVERS" --topic test-topic --new-consumer --from-beginning --max-messages 10000 --consumer.config /tmp/consumer.config

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Jonathan Apodaca

unread,
Jul 25, 2016, 5:27:24 PM7/25/16
to Confluent Platform
Roger, out of curiosity, is it normal that I get a 404 at this endpoint when in the Control Panel UI?:
...

Roger Hoover

unread,
Jul 25, 2016, 6:08:27 PM7/25/16
to confluent...@googlegroups.com
Jonathan,

Yes, that's normal when there's no data to display for that time window.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Roger Hoover

unread,
Jul 25, 2016, 6:39:40 PM7/25/16
to confluent...@googlegroups.com
We tracked down the issue.  The connect-distributed start script is adding an empty path ":" at the beginning of the CLASSPATH and since we running the code from the root directory, it effectively added "/" to the classpath which it then searches to find connector plugins.  This explains why Connect was taking to long to do this search.  This should get fixed in the next release.

In the meantime, a work around is to cd to some other directory first when starting Connect.

cd /etc/kafka && /usr/bin/connect-distributed /tmp/connect-distributed.properties


--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Vadim Dzyuban

unread,
Jul 26, 2016, 2:53:02 PM7/26/16
to Confluent Platform
Hi Roger,
I've ran the scripts you provided, but still unable to get control center web ui working, I'm getting the blank list of topics, consumer groups, active tasks, etc, no information at all.
I'm running docker container on linux server, let's say XYZ. Inside docker container there is the linux too with java and confuent 3.
Here is the question:  in your script what values should I use for "$ZOOKEEPER_CONNECT" and  "$BOOTSTRAP_SERVERS" ?
I replaced the  "$BOOTSTRAP_SERVERS" with the XYZ:9021, is this correct ?   and what should I use for  "$BOOTSTRAP_SERVERS" ?
Than I'm accessing control center web ui at http://XYZ:9021 which is rendered but with blank list of topics, messages.
Am I missing something ?

Thank you for your patience and help.  

On Monday, July 25, 2016 at 4:37:59 PM UTC-4, Roger Hoover wrote:
Hi Vadim,

Thanks.
[2016-07-22 15:40:04,311] WARN The configuration producer.interceptor.classes =<span style="

Roger Hoover

unread,
Jul 26, 2016, 4:44:21 PM7/26/16
to confluent...@googlegroups.com
Hi Vadim,

These should be the values you need.

#ZooKeeper is 2181
export ZOOKEEPER_CONNECT=localhost:2181

#Kafka is 9092
export BOOTSTRAP_SERVERS=localhost:9092

Does that work?

Cheers,

Roger

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Vadim Dzyuban

unread,
Jul 26, 2016, 5:42:09 PM7/26/16
to Confluent Platform
Yes, it worked for me and now I can see the created topics: test-topic and poem.
A few more questions please:

(1)how can I see the content of the messages, is it possible ?

(2)let's say I'd like to connect to remote linux server 'remote-server' on port 2181.
    I have kafka running stuff on that server and I'd like to monitor those topics/massages with the control center web ui.
    How can I do that ? Could you please outline the main steps ?

Thank you very much Roger for your help
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Roger Hoover

unread,
Jul 26, 2016, 6:16:28 PM7/26/16
to confluent...@googlegroups.com
Hi Vadim,

See inline below.

On Tue, Jul 26, 2016 at 2:42 PM, Vadim Dzyuban <vadim....@gmail.com> wrote:
Yes, it worked for me and now I can see the created topics: test-topic and poem.
A few more questions please:

(1)how can I see the content of the messages, is it possible ?


You mean the content of the monitoring messages sent to the _confluent-monitoring topic?  They're intended to be internal to Control Center so you can't easily inspect them.

 
(2)let's say I'd like to connect to remote linux server 'remote-server' on port 2181.
    I have kafka running stuff on that server and I'd like to monitor those topics/massages with the control center web ui.
    How can I do that ? Could you please outline the main steps ?


If Control Center is running the same Kafka cluster as your application, you need to

1) add the "interceptor.classes" config params to your producers and consumers in your application.
2) set the zookeeper.connect and bootstrap.server params on the Control Center config to match your cluster setup.

 
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Vadim Dzyuban

unread,
Jul 27, 2016, 9:49:19 AM7/27/16
to Confluent Platform
In regard to my question: I meant, does control center web ui allow to review the content of received messages of particular topic ? and if so to review the messages in different formats f.i. string, xml, json, like kafka tool does (http://www.kafkatool.com/) ?

Thank you Roger for your response and help.
Hi Vadim,

See inline below.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Roger Hoover

unread,
Jul 27, 2016, 4:10:00 PM7/27/16
to confluent...@googlegroups.com
Oh, I see what you mean.  The Control Center UI does not support browsing messages.  I think it could be a nice feature though.

For now, I think the easiest way to browse your Kafka messages is to use the console consumers.

#Reads any data

$ /usr/bin/kafka-console-consumer --zookeeper localhost:2181 --topic test-topic --from-beginning

#Reads Avro data and converts it to JSON for human readability

$ /usr/bin/kafka-avro-console-consumer --topic test --zookeeper localhost:2181 --from-beginning


Hi Vadim,

See inline below.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

Ryan Anguiano

unread,
Jul 28, 2016, 8:28:31 AM7/28/16
to Confluent Platform
Thank you!!!

I just added this to my docker container and it worked like a charm.

WORKDIR /etc/kafka

...

Vadim Dzyuban

unread,
Jul 28, 2016, 10:17:02 AM7/28/16
to Confluent Platform
Thank you Ryan for sharing this tip.
Thank you!!!
[2016-07-22 15:41:17,097] WARN checking license failure: Unable to process JOSE object (cause: org.jose4j.lang.JoseException: Invalid JOSE Compact Serialization. Expecting either 3 or 5 parts for</

Vadim Dzyuban

unread,
Jul 28, 2016, 12:22:51 PM7/28/16
to Confluent Platform
Thank you very much Roger for your help !
Hi Vadim,

See inline below.

Thanks.
~# tail -f /var/log/control-center.log
[2016-07-22 15:41:16,566] WARN file=dist/index.html length=311<span style="colo

Mike Sparr

unread,
Aug 18, 2016, 2:07:42 PM8/18/16
to Confluent Platform
You might check out Trifecta for browsing/searching of Kafka topics and messages. They split CLI and UI packages recently and it's still the best insight into the cluster I've seen so far, especially from a browser. You can also decode AVRO, etc. and view message keys (toggle) or content.

https://github.com/ldaniels528/trifecta
Reply all
Reply to author
Forward
0 new messages