[VSAONLINE-10] Luke Yi. February 10, 2025 20:00 GMT
Evgeny Osipov
Dear all,
Welcome to the next talk on VSAONLINE by Luke Yi from Stanford University!
Date: February 10, 2025
Time: 20:00 GMT
Zoom: https://ltu-se.zoom.us/j/65564790287
Title: ” Hardware-Aware Optimization of Hyperdimensional Computations”
Abstract: Hyperdimensional computation (HDC) is a brain-inspired, lightweight computing paradigm that has shown great potential for edge inference and inference on emerging hardware technologies, achieving state-of-the-art accuracy on certain classification tasks. HDC classifiers are inherently error resistant and support early termination of inference tasks to obtain approximate classification results. Practitioners have developed heuristic methods to terminate inference early on a per-input basis, reducing the computational cost of inference at the cost of accuracy. These techniques lack formal guarantees and therefore may unacceptably degrade classification accuracy or terminate inference tasks later than needed.
We present Omen, the first dynamic HDC optimizer that uses inferential statistics to terminate inference early while providing accuracy guarantees. To realize Omen, we develop a statistical view of HDC that reframes HD computations as statistical sampling and testing tasks, enabling the use of statistical tests. We evaluate Omen on 19 benchmark instantiations of four classification tasks. Omen is computationally efficient, delivering up to 7.21-12.18x inference speed-ups over an unoptimized baseline while only incurring a 0.0-0.7\% drop in accuracy. Omen outperforms heuristic methods, achieving an additional 1.04-5.85x inference speed-up over heuristic methods while maintaining higher or comparable accuracy.
Best,
Evgeny