Real multiple IMap stream Joins

[Pranas Baliuka]

Hi,

What are bets practices to perform joins between multiple streams?

Correct me if I'm wroing but, the only one Journaled IMap stream enrichment with static data is supported out of the box at the moment.

Thanks for sharing your experience!

[Viliam Durina]

Currently, we support co-grouping into windows: timestamped events from multiple streams will be collected and the result will be emitted as a tuple of {windowStart, windowEnd, list_input1, list_input2, ...}. Have a look at the sample: https://github.com/hazelcast/hazelcast-jet/blob/4.2-maintenance/examples/co-group/src/main/java/com/hazelcast/jet/examples/cogroup/WindowedCoGroup.java#L122-L123

You can also implement a time-bounded join, but we don't have special support for that, it will be a lot of manual work. You need to merge multiple streams and then implement custom logic in `mapStateful`.

Viliam

Visit our website at http://www.algoteq.com

Privileged/Confidential information may be contained in this message and may be subject to legal privilege. Access to this e-mail by anyone other than the intended is unauthorised. If you are not the intended recipient (or responsible for delivery of the message to such person), you may not use, copy, distribute or deliver to anyone this message (or any part of its contents) or take any action in reliance on it. In such case, you should destroy this message, and notify us immediately. If you have received this email in error, please notify us immediately by e-mail and delete the e-mail from your computer. If you or your employer does not consent to internet e-mail messages of this kind, please notify us immediately. All reasonable precautions have been taken to ensure no viruses are present in this e-mail. As Algoteq Pty Ltd cannot accept responsibility for any loss or damage arising from the use of this e-mail or attachments we recommend that you subject these to your virus checking procedures prior to use. The views, opinions, conclusions and other informations expressed in this electronic mail are not given or endorsed by the company unless otherwise indicated by an authorised representative independent of this message.

--
You received this message because you are subscribed to the Google Groups "hazelcast-jet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast-je...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast-jet/688c468d-9b49-46ba-9544-beb5b3a8ee75n%40googlegroups.com.

--

Viliam Durina

Jet Developer

			hazelcast®

2 W 5th Ave, Ste 300 | San Mateo, CA 94402 | USA
+1 (650) 521-5453 | hazelcast.com

This message contains confidential information and is intended only for the individuals named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required, please request a hard-copy version. -Hazelcast