Kafka Streams: java.lang.IllegalArgumentException

[vivek sharma]

Hi Mates - Does any one face the below error with Kafka Streams? Some records are getting processes then Kafka Streams is getting ended with the below error:

Exception in thread "StreamThread-1" java.lang.IllegalArgumentException: Invalid timestamp -1
        at org.apache.kafka.clients.producer.ProducerRecord.<init>(ProducerRecord.java:60)
        at org.apache.kafka.streams.processor.internals.SinkNode.process(SinkNode.java:72)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:338)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
        at org.apache.kafka.streams.kstream.internals.KStreamPassThrough$KStreamPassThroughProcessor.process(KStreamPassThrough.java:34)
        at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:351)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:192)
        at org.apache.kafka.streams.kstream.internals.KStreamBranch$KStreamBranchProcessor.process(KStreamBranch.java:46)
        at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
        at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:338)
        at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
        at org.apache.kafka.streams.processor.internals.SourceNode.process(SourceNode.java:64)
        at org.apache.kafka.streams.processor.internals.StreamTask.process(StreamTask.java:174)
        at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:320)
        at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)

[Matthias J. Sax]

Have a look here:
http://docs.confluent.io/3.1.2/streams/faq.html#invalid-timestamp-exception

If you have further question, just follow up.


-Matthias

> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

[vivek sharma]

Thanks Matthias to share this one, ConsumerRecordTimestampExtractor did not solve my problem however

WallclockTimestampExtractor solved it, Is there any reason behind that?

> an email to confluent-platform+unsub...@googlegroups.com
> <mailto:confluent-platform+unsub...@googlegroups.com>.

[Michael Noll]

Vivek,

the answer to your question is documented in the link that Matthias shared:
http://docs.confluent.io/3.1.2/streams/faq.html#invalid-timestamp-exception

> an email to confluent-platform+unsubscribe@googlegroups.com
> <mailto:confluent-platform+unsubsc...@googlegroups.com>.

> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Michael G. Noll

Product Manager | Confluent

+1 650 453 5860 | @miguno

Follow us: Twitter | Blog

[Matthias J. Sax]

Also a follow up:

If you switch to WallclockTimestampExtractor you will get different
results. Just to make you aware of this.

Cf. http://docs.confluent.io/current/streams/concepts.html#time

I would recommend you to read the whole docs about Streams. It should
answer many of you questions upfront.


-Matthias

> > an email to confluent-platf...@googlegroups.com
> > <mailto:confluent-platf...@googlegroups.com>.

> > To post to this group, send email to
> confluent...@googlegroups.com
> > <mailto:confluent...@googlegroups.com>.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com>
>

> > <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer

> <https://groups.google.com/d/msgid/confluent-platform/eb7c82fd-4a43-4957-9508-187263bd726b%40googlegroups.com?utm_medium=email&utm_source=footer>>.
>
> > For more options, visit https://groups.google.com/d/optout

> <https://groups.google.com/d/optout>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it,

> send an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.

> To post to this group, send email to
> confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/e1b15ee5-2b3b-4357-a31c-11f4fa019234%40googlegroups.com?utm_medium=email&utm_source=footer>.

>
> For more options, visit https://groups.google.com/d/optout

> <https://groups.google.com/d/optout>.
>
>
>
>
> --
> *Michael G. Noll*
> Product Manager | Confluent
> +1 650 453 5860 | @miguno <https://twitter.com/miguno>
> Follow us: Twitter <https://twitter.com/ConfluentInc> | Blog
> <http://www.confluent.io/blog>

>
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send

> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.

> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/confluent-platform/CAA4zQxJA4xrYkw2241EH1gxELOTepmPaGGqzhLduwbPZA_eMDg%40mail.gmail.com
> <https://groups.google.com/d/msgid/confluent-platform/CAA4zQxJA4xrYkw2241EH1gxELOTepmPaGGqzhLduwbPZA_eMDg%40mail.gmail.com?utm_medium=email&utm_source=footer>.