From the 1 of 10 linked papers with an AI index.
Showing math.APShow all
2 papers · 1 filter
math.AP2026
Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
Albert Alcalde, Leon Bungert, Konstantin Riedl +1
Transformers with self-attention modules as their core components have become an integral architecture in modern large language and foundation models. In this paper, we study the e…
math.AP2025
Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization
Martin Burger, Samira Kabri, Yury Korolev +2
The aim of this paper is to provide a mathematical analysis of transformer architectures using a self-attention mechanism with layer normalization. In particular, observed patterns…