This week we will have theory lunch in the usual time and place (GCS 502c at 12:00 PM). Our speaker will be Professor Vatsal Sharan, who will be giving the following talk:
Title: Using Algorithms to Understand Transformers, and Using Transformers to Understand Algorithms
I
will discuss how some algorithmic tools can help understand the
mechanisms employed by Transformers to solve basic computational tasks
such as linear regression, and how Transformers themselves could help
discover and design data structures for tasks such as nearest neighbor
search.
Hope to see you all there,
Grayson