How I can delete data from a log stream

17 views
Skip to first unread message

Jon Derrick

unread,
May 16, 2016, 2:39:06 AM5/16/16
to distributedlog-user
Is there any document on how to delete data from a log stream?

Thanks,
jderrick

Dave Rusek

unread,
May 16, 2016, 10:24:47 AM5/16/16
to Jon Derrick, distributedlog-user

Jon,

If you are asking about randomly deleting data from a position in the stream (or HEAD), that is not possible. A DL stream is an immutable, append only stream with a time and/or size based retention policy.

-Dave
@davidjrusek

--
You received this message because you are subscribed to the Google Groups "distributedlog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to distributedlog-...@googlegroups.com.
To post to this group, send email to distribut...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/distributedlog-user/7f9ea7c3-9e5a-4d94-a5eb-a59e610becb4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Dave Rusek

unread,
May 16, 2016, 10:26:28 AM5/16/16
to Jon Derrick, distributedlog-user

One notable exception, data may be truncated but I will need to dig up those docs.

Sijie Guo

unread,
May 17, 2016, 3:59:19 PM5/17/16
to distributedlog-user
Jon,

Added to what Dave pointed out, you could use

- AsyncLogWriter#truncate(DLSN)
or
- DistributedLogClient#truncate(stream, DLSN)

to truncate a DL stream to a given offset `DLSN`.

- Sijie


On Monday, May 16, 2016 at 7:26:28 AM UTC-7, drusek wrote:

One notable exception, data may be truncated but I will need to dig up those docs.

On May 16, 2016 8:24 AM, "Dave Rusek" <dru...@twitter.com> wrote:

Jon,

If you are asking about randomly deleting data from a position in the stream (or HEAD), that is not possible. A DL stream is an immutable, append only stream with a time and/or size based retention policy.

-Dave
@davidjrusek

On May 16, 2016 12:39 AM, "Jon Derrick" <jonathan...@gmail.com> wrote:
Is there any document on how to delete data from a log stream?

Thanks,
jderrick

--
You received this message because you are subscribed to the Google Groups "distributedlog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to distributedlog-user+unsub...@googlegroups.com.
To post to this group, send email to distributedlog-user@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages