Bitpacking in the array container format

[Dan Burkert]

Hi all,

Has anyone done any research or prototypes on using posting list integer encoding like BP128 or PFOR to compress array containers?  This is a somewhat natural jump after having reading the Roaring and 'SIMD Compression and the Intersection of Sorted Integers' series of papers back to back.  Obviously it will make the size heuristics a bit more complicated, as well as the cross product of intersect/union routines against the other container types, but perhaps this could improve performance on particularly sparse data?  I'm curious what the experts think.

- Dan