Understanding Transformer from the Perspective of Associative Memory

Shu Zhong, Mingyu Xu, Tenglong Ao +1

In this paper, we share our reflections and insights on understanding Transformer architectures through the lens of associative memory--a classic psychological concept inspired by…