Hi All,
built a demo to compare non standard number systems at low bitwidth (4bit per channel) for llm..
Column 1 embeds, 2 linear, 3 log, 4 polar and 5 tapered (posit like)
Column 6 is FFN, uses a number format that avoids singularities at 0.
The visualization looks pretty cool.
https://kgrama.github.io/lnscpp/index.html