Does Hazelcast Jet support rolling number as IMap key, with Kafka as a source?

13 views
Skip to first unread message

srikan...@gmail.com

unread,
May 2, 2019, 9:55:20 AM5/2/19
to hazelcast-jet

I've used Hazelcast sometime back, using Hazelcast Jet for the first time and seems interesting for processing some real-time streaming, exploring through.

Here I've a situation, I'm pulling Kafka topic to IMap using

private static Pipeline buildPipelineForClientDataa() {
        Pipeline p = Pipeline.create();
        p.drawFrom(KafkaSources.kafka(
                props("bootstrap.servers", BOOTSTRAP_SERVERS, 
                        "key.deserializer", StringDeserializer.class.getCanonicalName(), 
                        "value.deserializer", StringDeserializer.class.getCanonicalName(), 
                        "auto.offset.reset", AUTO_OFFSET_RESET), 
                KAFKA_TOPIC))
        .withoutTimestamps()
        .drainTo(Sinks.map(SINK_CLINET_DATA));
        return p;
    }
Well, I've no Key for the topic. Should I've an option to assign rolling number as a key? If so, help me with the technique. Thanks.

Viliam Durina

unread,
May 2, 2019, 11:43:47 AM5/2/19
to srikan...@gmail.com, hazelcast-jet
Question was answered on StackOverflow, please continue there.
Viliam

--
You received this message because you are subscribed to the Google Groups "hazelcast-jet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast-je...@googlegroups.com.
To post to this group, send email to hazelc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast-jet/d169c224-4bc0-4bc8-aa9d-8fc27de73422%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages