Finally documented LZF format: https://github.com/ning/compress/wiki/LZFFormat

89 views
Skip to first unread message

Tatu Saloranta

unread,
Mar 7, 2013, 6:01:54 PM3/7/13
to jvm-compress...@googlegroups.com
Not sure if anyone here is interested, but one item from my long TODO
list was to document LZF format, as defined by original lzf tool.
So here it is:

https://github.com/ning/compress/wiki/LZFFormat

Other recent news:

- Lz4 codecs (both JNI version and pure java) are included in
codebase, and give some rather impressive numbers -- fastest codec on
JVM for now
- I updated LZF version to 0.9.7, and now speed is quite similar to
Snappy/Java (which is actually similar to Snappy/JNI as well).

It certainly looks like 'sun.misc.Unsafe' is pretty much required for
top speeds on JVM -- for LZF, decompression speed is 2x that of "safe"
variant, and both LZ4 and Snappy java codecs similarly use it.

I still don't have a good answer to the question of how to automate
running (and ideally publishing) tests; and currently do not have
enough time to do that manually. But I am hoping that further
automation of cloud services makes the problem easier to crack over
time. :-)
And help in this area would obviously be appreciated.

-+ Tatu +-
Reply all
Reply to author
Forward
0 new messages