error in word count kafka streams application

103 views
Skip to first unread message

Andrey Plaksin

unread,
Jun 13, 2016, 5:43:19 AM6/13/16
to Confluent Platform
Hi 

i have a single node confluent platform 3.0 installed on a VM in google cloud 

i configured advertised.listeners to the provided external ip address and added the required rules to the firewall (allowing port 9092 and 2181)

when i start the application i see the following WARN in the console (replaced ip address with X.X.X.X

ARN org.apache.zookeeper.ClientCnxn  - Session 0x15549122a250004 for server X.X.X.X/X.X.X.X:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: An existing connection was forcibly closed by the remote host
at sun.nio.ch.SocketDispatcher.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(Unknown Source)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(Unknown Source)
at sun.nio.ch.IOUtil.read(Unknown Source)
at sun.nio.ch.SocketChannelImpl.read(Unknown Source)
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

there are no obvious errors on the server side , the broker seems to see the new connection, it creates a customer group and stabilizes it 



Andrey Plaksin

unread,
Jun 13, 2016, 6:09:23 AM6/13/16
to Confluent Platform
the preceeding output on the application side is 

823 [StreamThread-1] DEBUG org.apache.kafka.clients.consumer.internals.ConsumerCoordinator  - Performing assignment for group wordcount-lambda-example using strategy stream with subscriptions {wordcount-lambda-example-1-StreamThread-1-consumer-43e4862b-45d3-45df-ad5c-12947e79f1a8=Subscription(topics=[TextLinesTopic])}
825 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.
825 [StreamThread-1] INFO org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Completed validating internal topics in partition assignor.
831 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.
831 [StreamThread-1] INFO org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Completed validating internal topics in partition assignor.
831 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.

Guozhang Wang

unread,
Jun 14, 2016, 1:58:54 PM6/14/16
to Confluent Platform
The WARNING log usually means the Zookeeper server is not reachable from the broker side, or is not up and running at all.

Was the word count example completed successfully regardless the warning log entries, or does it fail to complete?

Guozhang
Reply all
Reply to author
Forward
0 new messages