6 citations · 10 across the 19 of their papers we have counts for
Showing math.PRShow all
2 papers · 1 filter
math.PR2026
Homogenized Transformers
Hugo Koubbi, Borjan Geshkovski, Philippe Rigollet
We study a random model of deep multi-head self-attention in which the weights are resampled independently across layers and heads, as at initialization of training. Viewing depth…
math.PR2025
On the Structure of Stationary Solutions to McKean-Vlasov Equations with Applications to Noisy Transformers
Krishnakumar Balasubramanian, Sayan Banerjee, Philippe Rigollet
We study stationary solutions of McKean-Vlasov equations on the circle. Our main contributions stem from observing an exact equivalence between solutions of the stationary McKean-V…