November 7th FPTalks Community Meeting: Ebby Samson on Exploring FPGA designs for MX and beyond
Ian Briggs
Howdy folks!
Next Thursday, November 7th at 9:00-10:00 AM pacific time, will be the next FPTalks Community Meeting.
If you are searching for the Zoom link, look no further: https://washington.zoom.us/j/92831331326
We are very excited to welcome Ebby Samson from Imperial College London to present on Exploring FPGA designs for MX and beyond!
A number of companies recently worked together to release the new Open Compute Project MX standard for low-precision computation, aimed at efficient neural network implementation. In our work, we describe and evaluate the first open-source FPGA implementation of the arithmetic defined in the standard. Our designs fully support all the standard's concrete formats for conversion into and out of MX formats and for the standard-defined arithmetic operations, as well as arbitrary fixed-point and floating-point formats. Certain elements of the standard are left as implementation-defined, and we present the first concrete FPGA-inspired choices for these elements. Our library of optimized hardware components is available open source, alongside our open-source Pytorch library for quantization into the new standard, integrated with the Brevitas library so that the community can develop novel neural network designs quantized with MX formats in mind. Our testing shows that MX is very effective for formats such as INT5 or FP6 which are not natively supported on GPUs. This gives FPGAs an advantage as they have the flexibility to implement a custom datapath and take advantage of the smaller area footprints offered by these formats
We look forward to seeing everyone!
As a reminder, if you would like to give a talk or know of someone that would be great for an FPBench Community meeting, please have them fill out the speaker suggestion form!
Ian Briggs
Howdy folks!
This Thursday, November 7th at 9:00-10:00 AM pacific time, will be the next FPTalks Community Meeting.