stream partition error during startup

1,281 views
Skip to first unread message

Shannon Ma

unread,
Mar 23, 2017, 11:57:32 AM3/23/17
to Confluent Platform
Hi,

My first time testing partition, so i created input/output topics with 3 partitions, and i see this error. 'correlation' is my input topic, 'XXXwindow' is my three aggregation window store names. Did i miss anything?



2017/03/23 11:45:12.756[ERROR][](StreamThread.java): stream-thread [StreamThread-1] Streams application error during processing:
java.lang.IllegalArgumentException: Assigned partition input-2 for non-subscribed topic regex pattern; subscription pattern is correlation|testtt-lanewindow-repartition|testtt-tagwindow-repartition|testtt-txnwindow-repartition
        at org.apache.kafka.clients.consumer.internals.SubscriptionState.assignFromSubscribed(SubscriptionState.java:190) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:216) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:339) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:286) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1030) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) ~[kafka-clients-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:582) ~[kafka-streams-0.10.2.0-cp1.jar!/:?]
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:368) [kafka-streams-0.10.2.0-cp1.jar!/:?]


Thanks
Shannon

Shannon Ma

unread,
Mar 23, 2017, 1:01:14 PM3/23/17
to Confluent Platform
More info, i am using 3.2.0, i have three different stream apps on the same box, first one's output is the second 's input, seconds' output is the input for the third one. All topics are created with 3 partitions.  

Matthias J. Sax

unread,
Mar 24, 2017, 12:41:52 PM3/24/17
to confluent...@googlegroups.com
Not sure why it's going wrong. It tried to assign partitions 2 of topic
"input" to the Streams consumer, and because Streams never subscribed to
this topic, it rejects the assignment and fails.

Did you ever create a topic with name "input" ?


-Matthias
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/54ebed3c-666f-490f-b1c7-3a660df9f962%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/54ebed3c-666f-490f-b1c7-3a660df9f962%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

signature.asc

Shannon Ma

unread,
Mar 24, 2017, 2:34:47 PM3/24/17
to Confluent Platform
I have two stream apps, but i mistakenly used the same app id.Once fixed it is ok now.


Thanks
Shannon
Reply all
Reply to author
Forward
0 new messages