Huff0 of long symbols (INT16)

47 views
Skip to first unread message

Evgeny Proshkin

unread,
Jun 22, 2020, 8:16:38 AM6/22/20
to LZ4c
Hi, is possible to adapt the library FiniteStateEntropy for compression Huff0 of long symbols? I interest for digits up to 14 bits

Cyan

unread,
Jun 22, 2020, 8:50:38 AM6/22/20
to LZ4c
FSE can be used to compress alphabets up to 12 bits in size.

Beyond that quantity, while the algorithm itself could be made to work with larger alphabets,
it would be necessary to code a specific implementation.
It's also questionable if it's a good idea, as FSE only shines when some symbols have dominant probabilities (>10%)
which is less likely when the alphabet becomes very big.

Avakin Life

unread,
Aug 1, 2020, 9:41:45 PM8/1/20
to LZ4c
Reply all
Reply to author
Forward
0 new messages