Reachability and asymptotics of Gaussian Transformer dynamics

Albert Alcalde, Zhengping Ji, Enrique Zuazua

We formulate data propagation through the Transformer, the machine learning architecture powering large language models, as a nonlinear control system on the space of probability m…