Re: lz4 - Extremely Fast Compression algorithm - Google Project Hosting
50 views
Skip to first unread message
Steffen Mueller
Nov 17, 2013, 2:03:36 PM11/17/13
to Damian Gryski, serea...@googlegroups.com, Yves Orton, Borislav Nikolov
Hi Damian, hi gang,
On 11/15/2013 10:37 PM, Damian Gryski wrote:
> BSD license. Speed comparable to snappy. Already has a native Go port,
> and bindings to lots of languages. Lzo is GPL, so even the single file
> implementation we couldn't use.
>
> Maybe I'll play with this for the hackathon.
>
> https://code.google.com/p/lz4/
this turns out to be a pretty damn good find. I implemented a prototype
in Sereal (branch 'lz4'). See attached text & plots.
For those following along: There's LZ4 and there's LZ4HC. The former is
comparable to Snappy in performance, the latter is a variant which tries
harder and is more comparable to zlib in performance (as in: dog slow
when compared to serialization time).
I think we should officially add support for this before we release a V2
final.
Best regards,
Steffen
On 11/15/2013 10:37 PM, Damian Gryski wrote:
> BSD license. Speed comparable to snappy. Already has a native Go port,
> and bindings to lots of languages. Lzo is GPL, so even the single file
> implementation we couldn't use.
>
> Maybe I'll play with this for the hackathon.
>
> https://code.google.com/p/lz4/
this turns out to be a pretty damn good find. I implemented a prototype
in Sereal (branch 'lz4'). See attached text & plots.
For those following along: There's LZ4 and there's LZ4HC. The former is
comparable to Snappy in performance, the latter is a variant which tries
harder and is more comparable to zlib in performance (as in: dog slow
when compared to serialization time).
I think we should officially add support for this before we release a V2
final.
Best regards,
Steffen
Reply all
Reply to author
Forward
0 new messages