Large-window brotli

313 views

Skip to first unread message

vanic...@google.com

unread,

Sep 27, 2016, 8:20:44 AM9/27/16

to Brotli

As part of my summer internship in the Google Research Europe compression team, I’m happy to announce that we are publishing a new experimental and incompatible derivative of brotli with a larger, up to 1 GB window size <https://github.com/google/brotli/tree/large-window>.

Once the large-window brotli matures, it can become a good fit for file archiving, patching, and compression research with large corpora, reducing the output size for large files significantly. For example, while the standard brotli produces 223 356 605 bytes for enwik9, the large-window brotli compresses it down to 199 118 013 bytes, a reduction of 11%. Please note that there is no plan to start using large window brotli for HTTP content encoding. While there is a size reduction for very large files, we consider the memory requirements more critical for web use.