2 citations · 2 across the 5 of their papers we have counts for
1 paper · 1 filter
Ernest Fokoué
We develop a rigorous statistical theory of multi-head attention (MHA) as an ensemble of Nadaraya-Watson (NW) kernel regression estimators. Building on the algebraic identity betwe…