New library for Posit on CUDA

[Aravind Voggu]

Heyo,

I have written a little library for Posit matrix multiplication on CUDA. It's available at https://github.com/zeroby0/cuPosit

It's meant for deep-learning and has it's own share of caveats, but can do Posit(n, es), 4 <= n <= 28, es == 2 at 4 TOPS on my RTX4090.

There's a function to round FP32 to Posit at: https://github.com/zeroby0/cuPosit/blob/main/cusrc/positclip.h . It works by truncating the mantissa in FP32 to the number of mantissa bits a posit with the same regime+exponent is allowed to have.

My lab works in developing posit hardware for AI/ML, so I wrote this to speed up our experiments, and we use it for Posit-QAT. I'm posting here in case it helps anyone else too :D

If you have any feedback or questions, please let me know. We intend to publish a paper on this implementation sometime soon.