Kafka streams and state machines

[Sabarish Sasidharan]

Hi

I am evaluating Kafka Streams for a platform we are building. I find Kafka Streams to be pretty expressive and simple to use, especially when it comes to aggregations on streams. But our platform also needs to support state machines. We want to be able to support complex state machines triggered by a series of events occuring in some order or expressions involving event attributes across a series of events.

For ex, construct an entity A if event E1 happens followed by E2 and E2's value is >r than threshold 20 and last E1 was more than 30 mins back. Update A's attributes by aggregating E3, E4 values till A reaches a final state marked by event E5.

Is such a thing possible through Kafka Streams? It didn't seem possible after reading through the docs.

Regards

Sab

[Michael Noll]

Sabarish,

have you already looked at the low-level Processor API of Kafka Streams?

http://docs.confluent.io/2.1.0-alpha1/streams/developer-guide.html#processor-api

The link above points to the Tech Preview documentation of upcoming Kafka 0.10 (which will include Kafka Streams).  The Tech Preview docs don't cover the Processor API in full detail, but it should be a starting point.

Best,

Michael

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3e43ec4a-b0b2-4ca1-8f93-6787fbe75b27%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Best regards,
Michael Noll


Michael G. Noll | Product Manager | Confluent | +1 650.453.5860
Download Apache Kafka and Confluent Platform: www.confluent.io/download

[Sabarish Sasidharan]

Thanks Michael

Any plans of a CEP on top of Kafka Streams? Or is there some recommended approach?

Regards

Sab

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAA4zQxJ2eBQgFu3441SJFw49UNJz5wXe6pYMZ470%2B8gmWp-Uow%40mail.gmail.com.