Derive max and min values using Kafka Streams

387 views
Skip to first unread message

junhi...@gmail.com

unread,
Jan 4, 2018, 6:51:40 PM1/4/18
to Confluent Platform
Hi,

I'm building my first application using Kafka Streams. One of the requirements is to create consolidated records that have the earliest start time, latest end time, max value of a certain field, among others.

Can these be done via Kafka Streams DSL ? If so, can you please provide a sample code. If not, can you suggest which Kafka component to use.

Thanks,
Jun

Hyun Joon Seol

unread,
Jan 4, 2018, 7:00:11 PM1/4/18
to Confluent Platform
You can do all of those with aggregations. 

It will be helpful to try things first after reading the docs and ask more specific questions when you're stuck.

Matthias J. Sax

unread,
Jan 5, 2018, 4:18:21 PM1/5/18
to confluent...@googlegroups.com
If you need to access record timestamps, you also need to use
.transfrom()...

https://docs.confluent.io/current/streams/faq.html#accessing-record-metadata-such-as-topic-partition-and-offset-information


-Matthias
> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/9f4614ca-142a-4e29-b52c-a2365ddec10b%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/9f4614ca-142a-4e29-b52c-a2365ddec10b%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.

signature.asc
Reply all
Reply to author
Forward
0 new messages