Kafka consumer client 0.9.0.1 API issue

324 views
Skip to first unread message

chao zhang

unread,
Mar 25, 2016, 3:20:06 AM3/25/16
to Confluent Platform

We found some strange issue when we upgrade 0.9.0.1 . Some consumer was suck and can not continue to move offset 

if we manually commit offset , it will throw the following exception . 


1. How does it happen ??

2. If it happen , how we can consumer message and move offset to latest , and continue consume with this group 


2016-03-25 14:37:57 DEBUG Metrics:201 - Added sensor with name node-2147483646.bytes-sent

2016-03-25 14:37:57 DEBUG Metrics:201 - Added sensor with name node-2147483646.bytes-received

2016-03-25 14:37:57 DEBUG Metrics:201 - Added sensor with name node-2147483646.latency

2016-03-25 14:37:57 DEBUG NetworkClient:492 - Completed connection to node 2147483646

2016-03-25 14:37:57 ERROR ConsumerCoordinator:544 - Error UNKNOWN_MEMBER_ID occurred while committing offsets for group XX_integration

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name connections-closed:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name connections-created:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name bytes-sent-received:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name bytes-received:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name bytes-sent:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name select-time:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name io-time:client-id-consumer-1

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node--3.bytes-sent

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node--3.bytes-received

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node--3.latency

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-0.bytes-sent

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-0.bytes-received

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-0.latency

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-2147483646.bytes-sent

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-2147483646.bytes-received

2016-03-25 14:38:02 DEBUG Metrics:220 - Removed sensor with name node-2147483646.latency

2016-03-25 14:38:02 DEBUG KafkaConsumer:1241 - The Kafka consumer has closed.

Exception in thread "main" org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed due to group rebalance

         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:546)

         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:487)

         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:681)

         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:654)

         at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)

         at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)

         at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)

         at 

Saravanan Tirugnanum

unread,
Aug 11, 2016, 11:48:08 PM8/11/16
to Confluent Platform
Any updates on this.. Were you be able  find the root cause as am facing the same..

Regards
Saravanan
Reply all
Reply to author
Forward
0 new messages