156 citations · 188 across the 12 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2021★ 2 cited
On the Regularity of Attention
James Vuckovic, Aristide Baratin, Remi Tachet des Combes
Attention is a powerful component of modern neural networks across a wide variety of domains. In this paper, we seek to quantify the regularity (i.e. the amount of smoothness) of t…
stat.ML2020★ 8 cited
A Mathematical Theory of Attention
James Vuckovic, Aristide Baratin, Remi Tachet des Combes
Attention is a powerful component of modern neural networks across a wide variety of domains. However, despite its ubiquity in machine learning, there is a gap in our understanding…