VSAONLINE. SEASON 13. September 7, 20:00GMT. Dhanraj Varun
Evgeny Osipov
Dear all,
Welcome to the FIRST talk of Season 12 on VSAONLINE. Dhanraj Varun from University of Waterloo, Canada
will give a talk
” Scalable Neurosymbolic LLM Reasoning via Multi-Token Encoding”
Date: September 7, 2026
Time: 20:00 GMT
Zoom: https://ltu-se.zoom.us/j/65564790287
Abstract: Large language models (LLMs) struggle with reliable rule-based reasoning, particularly in mathematical domains requiring precise computation. Recent neurosymbolic approaches have shown promise by encoding LLM hidden states into neurosymbolic representations to perform rule-based reasoning, but current methods rely on linear encoders applied to a single token’s hidden state, limiting representational capacity and robustness to input variations. This work extends previous neurosymbolic LLM methods by replacing linear encoders with transformer-based architectures that encode multiple hidden states from the model’s forward pass, enabling the model to capture information distributed across longer input sequences. We evaluate the method on arithmetic prompts in a low-data 3-digit setting with varied question formats and in 4/6-digit scaling experiments. The transformer encoder achieves 93.1% average accuracy, compared to 53.6% for the linear encoder, and remains substantially more robust as input length increases.