1 citations · 2 across the 6 of their papers we have counts for
3 papers · 1 filter
Reachability and asymptotics of Gaussian Transformer dynamics
Albert Alcalde, Zhengping Ji, Enrique Zuazua
We formulate data propagation through the Transformer, the machine learning architecture powering large language models, as a nonlinear control system on the space of probability m…
Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
Albert Alcalde, Leon Bungert, Konstantin Riedl +1
Transformers with self-attention modules as their core components have become an integral architecture in modern large language and foundation models. In this paper, we study the e…
Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics
Albert Alcalde, Markus Widhalm, Emre Yılmaz
We propose the time-delayed transformer (TD-TF), a simplified transformer architecture for data-driven modeling of unsteady spatio-temporal dynamics. TD-TF bridges linear operator-…