Hello,
I am happy to announce that we've released the first public version of Hazelcast Jet – a new open source distributed computing engine by Hazelcast.
Hazelcast Jet is built for high-performance stream processing and fast batch processing. It embeds Hazelcast In-Memory Data Grid (IMDG) to provide a lightweight package of a processor and a scalable in-memory storage.
Features:
Low latency and distributed general data processing framework with high throughput.
Highly parallel and distributed stream and batch processing of data.
Distributed java.util.stream API support for Hazelcast data structures such as IMap and IList.
Connectors allowing high-velocity ingestion of data from Apache Kafka, HDFS, Hazelcast IMDG, sockets and local data files (such as logs or CSVs)
API for custom connectors
Distributed implementations of java.util.Map and List data structures highly optimized to be used for the processing
Dynamic node discovery for both on-premise and cloud deployments.
Virtualization support and resource management via Docker, YARN and Mesos
Please visit jet.hazelcast.org to learn more about the architecture and use-cases.
Also join the mail group if you are interested in using or developing Hazelcast Jet.
http://groups.google.com/group/hazelcast-jet
Vladimir Schreiner