kafka streams application error

90 views
Skip to first unread message

Andrey Plaksin

unread,
Jun 13, 2016, 8:44:20 AM6/13/16
to kafka-clients
hi 

i have a confluent platform set up on google compute engine
I changed the advertised.listener to the external ip and set up the firewall rules to accept 2181 and 9092 ports 

tested the console producer and console consumer and everything works fine

than i created a kafka stream application on my dev machine using the word count example 
basically the same code with different addresses for my instance 

the application starting to run and it seems it is successfully connected to my cluster (i can see connection established in the zookeeper output and in the broker output)

but i get the following error in the eclipse concole 

`839 [StreamThread-1] DEBUG org.apache.kafka.clients.consumer.internals.AbstractCoordinator  - Received successful join group response for group wordcount-lambda-example: {error_code=0,generation_id=1,group_protocol=stream,leader_id=wordcount-lambda-example-1-StreamThread-1-consumer-77edee01-647b-47ec-9fd6-66cfcaea51ef,member_id=wordcount-lambda-example-1-StreamThread-1-consumer-77edee01-647b-47ec-9fd6-66cfcaea51ef,members=[{member_id=wordcount-lambda-example-1-StreamThread-1-consumer-77edee01-647b-47ec-9fd6-66cfcaea51ef,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=54 cap=54]}]}
840 [StreamThread-1] DEBUG org.apache.kafka.clients.consumer.internals.ConsumerCoordinator  - Performing assignment for group wordcount-lambda-example using strategy stream with subscriptions {wordcount-lambda-example-1-StreamThread-1-consumer-77edee01-647b-47ec-9fd6-66cfcaea51ef=Subscription(topics=[TextLinesTopic])}
841 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.
842 [StreamThread-1] INFO org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Completed validating internal topics in partition assignor.
848 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.
848 [StreamThread-1] INFO org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Completed validating internal topics in partition assignor.
848 [StreamThread-1] DEBUG org.apache.kafka.streams.processor.internals.StreamPartitionAssignor  - Starting to validate internal topics in partition assignor.
19758 [main-SendThread(X.X.X.X:2181)] WARN org.apache.zookeeper.ClientCnxn  - Session 0x1554988bc9e0007 for server X.X.X.X/X.X.X.X:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: An existing connection was forcibly closed by the remote host
at sun.nio.ch.SocketDispatcher.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(Unknown Source)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(Unknown Source)
at sun.nio.ch.IOUtil.read(Unknown Source)
at sun.nio.ch.SocketChannelImpl.read(Unknown Source)
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
19866 [main-EventThread] DEBUG org.I0Itec.zkclient.ZkClient  - Received event: WatchedEvent state:Disconnected type:None path:null
19866 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient  - zookeeper state changed (Disconnected)`
Reply all
Reply to author
Forward
0 new messages