VSAONLINE-10. Chatterjee Abhijit, Georgia Institute of Technology.
Evgeny Osipov
Dear all,
Welcome to the next talk on VSAONLINE by Chatterjee Abhijit, Georgia Institute of Technology, USA!
Date: March 24, 2025
Time: 20:00 GMT
Zoom: https://ltu-se.zoom.us/j/65564790287
Title: RESOLVE: Reasoning in Hyperdimensional Spaces With Relational and Object Level Features Using Vector Symbolic Processing
March 24, 2025. 20:00GMT
Abstract: Modern transformer-based encoder-decoder architectures struggle with reasoning tasks due to their inability to effectively extract relational information between input objects (data/tokens) without interference from object level information. To address this, we propose RESOLVE, a neuro-vector symbolic architecture that first mixes object-level features with relational information in high-dimensional spaces, using fast and efficient operations such as bundling (summation) and binding (Hadamard product). This allows both object-level features and relational representations to coexist within the same symbolic structure without interfering with one another, while maintaining a high level of abstraction. RESOLVE is driven by a novel attention mechanism that operates in a bipolar high dimensional space, allowing fast attention score computation compared to the state-of-the-art. By leveraging this design, the model achieves both low compute latency and memory efficiency. RESOLVE also offers better generalizability while achieving higher accuracy in tasks such as mathematical reasoning compared to state-of-the-art methods.
Best,
Evgeny