Kafka Streams Tumbling Window Aggregation

[adr...@softmad.pl]

Hi, 

I'm checking out Kafka Streams and I'm having trouble coping with the "windows without end" concept. I have stream of stock prices and I want to create 1 minute OHLC bars out of them. I've created aggregation with tumbling window of specified time and output results into another kafka topic. When I register to that topic I'm seeing multiple entries per window. I've googled a little and learned that this is expected due to the way that Kafka Streams handle late arrived records but now I'm not sure that it's possible to create OHLC bars with this library. Maybe someone can point me into right direction?

[Matthias J. Sax]

Hi,

not sure what tool you use to do the OHLC bars? Basically, you need to
de-duplicate the output, and only keep the latest one for each key.

Can you elaborate on you use case and end-to-end pipeline so we can give
a more precise answer?

-Matthias

> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/0db003b9-72d1-42b2-ac42-5d7b525b8490%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/0db003b9-72d1-42b2-ac42-5d7b525b8490%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.