Commit cannot be completed exception

35 views

Skip to first unread message

Mike

unread,

Feb 1, 2018, 12:27:11 AM2/1/18

to Confluent Platform

Can someone provide more detail on the error below? From reading it, it does not seem as though its critical, as the work will be picked up by another worker. However, i would like to know what may cause this and how to best resolve.

I have found articles that stated that setting group.session.timeout.ms in server.properties will help. I do not see this property however and instead see zookeeper.session.timeout.ms.

org.apache.kafka.streams.errors.StreamsException: stream-thread [StreamThread-20] Failed to rebalance

at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:612)

at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:368)

Caused by: org.apache.kafka.streams.errors.StreamsException: stream-thread [StreamThread-20] failed to suspend stream tasks

at org.apache.kafka.streams.processor.internals.StreamThread.suspendTasksAndState(StreamThread.java:488)

at org.apache.kafka.streams.processor.internals.StreamThread.access$1200(StreamThread.java:69)

at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsRevoked(StreamThread.java:259)

at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:396)

at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:329)

at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303)

at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:286)

at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1030)

at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995)

at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:582)

... 1 more

Caused by: org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.

at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.sendOffsetCommitRequest(ConsumerCoordinator.java:698)

at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:577)

at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1125)

at org.apache.kafka.streams.processor.internals.StreamTask.commitOffsets(StreamTask.java:296)

at org.apache.kafka.streams.processor.internals.StreamThread$3.apply(StreamThread.java:535)

at org.apache.kafka.streams.processor.internals.StreamThread.performOnAllTasks(StreamThread.java:503)

at org.apache.kafka.streams.processor.internals.StreamThread.commitOffsets(StreamThread.java:531)

at org.apache.kafka.streams.processor.internals.StreamThread.suspendTasksAndState(StreamThread.java:480)