self-learning bitmap

93 views
Skip to first unread message

Chris Burroughs

unread,
Jun 29, 2012, 9:34:31 AM6/29/12
to stream-...@googlegroups.com, Yuki Morishita
> Other alternative is self-learning bitmap
(http://ect.bell-labs.com/who/aychen/sbitmap4p.pdf) which, in my
understanding, is more memory efficient when counting small values.

In another thread on the Cassandra mailing list the topic of
self-learning bitmap's for cardinality estimation came up (thanks
Yuki!). This isn't one I've previously encountered during literature
search. Does anyone have any experience with them?

Eugene Kirpichov

unread,
Jun 29, 2012, 8:52:23 PM6/29/12
to stream-...@googlegroups.com, Yuki Morishita
I read through the article; the algorithm seems cool, extremely
efficient (a couple of additions/bit operations per item; not even
multiplications are needed) and plausible.

I didn't read into the analysis; I think I'll try implementing it and
experimenting with it.
--
Eugene Kirpichov
http://www.linkedin.com/in/eugenekirpichov

Eugene Kirpichov

unread,
Jun 29, 2012, 8:53:25 PM6/29/12
to stream-...@googlegroups.com, Yuki Morishita
...of course 1 hash per item is also needed.
Reply all
Reply to author
Forward
0 new messages