Difference retention.ms & delete.retention.ms

[Simon Teles]

Hello,

I'm not sure to properly understand the difference between retention.ms and delete.retention.ms, can someone explain it ?

Thanks ;)

Simon

[Matthias J. Sax]

Hi,

retention.ms applies to topic swith clean up policy "delete" and sets
the retention time for those topics.

delete.retention.ms applies to topic with clean up policy "compact" and
is used for tombstone messages only. Tombstone messages have the format
<key:null> and indicate that a record with this key can be removed
completely (ie, delete semantics). This includes the removal of the
tombstone itself, too.

Instead of an immediate removal, `delete.retention.ms` is used to delay
the tombstone removal to retain the tombstone somewhat longer. The
motivation is that some consumers may already have consumed the old
record but not yet the tombstone. If log compaction happens and
tombstone gets deleted, the consumer might miss the tombstone. The
delayed removal helps to avoid this issue.


-Matthias

> --
> You received this message because you are subscribed to the Google
> Groups "Confluent Platform" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to confluent-platf...@googlegroups.com
> <mailto:confluent-platf...@googlegroups.com>.
> To post to this group, send email to confluent...@googlegroups.com
> <mailto:confluent...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/confluent-platform/30201809-5c6a-4e86-8201-c76dfd01cb77%40googlegroups.com
> <https://groups.google.com/d/msgid/confluent-platform/30201809-5c6a-4e86-8201-c76dfd01cb77%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.