Test-time regression: a unifying framework for designing sequence models with associative memory

Ke Alexander Wang, Jiaxin Shi, Emily B. Fox

Sequence models lie at the heart of modern deep learning. However, rapid advancements have produced a diversity of seemingly unrelated architectures, such as Transformers and recur…