Trident's Guranteeing Message processing issue

Skip to first unread message

churly lin

Dec 11, 2013, 3:21:48 AM12/11/13
Hi all:

     Does a trident topology support a method to inform the user that a batch of tuples has been 'fully processed"?

    My situation is:
    I read data from kafka then process the input data. And after the batch of input tuples has been fully processed, I write the processed kafka message offset into Zookeeper. So that I can read from kafka using this stored offset next time when I restart the topology. To realize this strategy, I need to be informed when a batch has been fully processed, am I right?.
    So, Does trident support a way to inform user if a batch of tuples has been fully processed or not?

    Thank you.

Reply all
Reply to author
0 new messages