Kafka Streams: java.lang.IllegalArgumentException

32 views
Skip to first unread message

vivek sharma

unread,
Feb 14, 2017, 7:54:56 PM2/14/17
to Confluent Platform
Hi Mates - Does any one face the below error with Kafka Streams? Some records are getting processes then Kafka Streams is getting ended with the below error:

Exception in thread "StreamThread-1" java.lang.IllegalArgumentException: Invalid timestamp -1
        at org.apache.kafka.clients.producer.ProducerRecord.<init>(ProducerRecord.java:60)
        at org.apache.kafka.streams.processor.internals.SinkNode.process(SinkNode.java:72)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:338)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
        at org.apache.kafka.streams.kstream.internals.KStreamPassThrough$KStreamPassThroughProcessor.process(KStreamPassThrough.java:34)
        at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:351)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:192)
        at org.apache.kafka.streams.kstream.internals.KStreamBranch$KStreamBranchProcessor.process(KStreamBranch.java:46)
        at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:338)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
        at org.apache.kafka.streams.processor.internals.SourceNode.process(SourceNode.java:64)
        at org.apache.kafka.streams.processor.internals.StreamTask.process(StreamTask.java:174)
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:320)
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)

Matthias J. Sax

unread,
Feb 14, 2017, 9:08:41 PM2/14/17
to confluent...@googlegroups.com
Have a look here:
http://docs.confluent.io/3.1.2/streams/faq.html#invalid-timestamp-exception

If you have further question, just follow up.


-Matthias
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

signature.asc

vivek sharma

unread,
Feb 14, 2017, 10:00:34 PM2/14/17
to Confluent Platform
Thanks Matthias to share this one, ConsumerRecordTimestampExtractor did not solve my problem however 
WallclockTimestampExtractor solved it, Is there any reason behind that?

Michael Noll

unread,
Feb 14, 2017, 10:18:13 PM2/14/17
to confluent...@googlegroups.com
Vivek,

the answer to your question is documented in the link that Matthias shared:
http://docs.confluent.io/3.1.2/streams/faq.html#invalid-timestamp-exception



--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Michael G. Noll
Product Manager | Confluent
Follow us: Twitter | Blog

Matthias J. Sax

unread,
Feb 14, 2017, 11:52:49 PM2/14/17
to confluent...@googlegroups.com
Also a follow up:

If you switch to WallclockTimestampExtractor you will get different
results. Just to make you aware of this.

Cf. http://docs.confluent.io/current/streams/concepts.html#time

I would recommend you to read the whole docs about Streams. It should
answer many of you questions upfront.


-Matthias
> > an email to confluent-platf...@googlegroups.com
> > <mailto:confluent-platf...@googlegroups.com>.
> > To post to this group, send email to
> confluent...@googlegroups.com
> > <mailto:confluent...@googlegroups.com>.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com>
>
> > <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer>>.
>
> > For more options, visit https://groups.google.com/d/optout
> <https://groups.google.com/d/optout>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to
> confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com?utm_medium=email&utm_source=footer>.
>
> For more options, visit https://groups.google.com/d/optout
> <https://groups.google.com/d/optout>.
>
>
>
>
> --
> *Michael G. Noll*
> Product Manager | Confluent
> +1 650 453 5860 | @miguno <https://twitter.com/miguno>
> Follow us: Twitter <https://twitter.com/ConfluentInc> | Blog
> <http://www.confluent.io/blog>
>
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/CAA4zQxJA4xrYkw2241EH1gxELOTepmPaGGqzhLduwbPZA_eMDg%40mail.gmail.com
> <https://groups.google.com/d/msgid/confluent-platform/CAA4zQxJA4xrYkw2241EH1gxELOTepmPaGGqzhLduwbPZA_eMDg%40mail.gmail.com?utm_medium=email&utm_source=footer>.
signature.asc
Reply all
Reply to author
Forward
0 new messages