8 citations · 8 across the 6 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Induction Heads Interpolate N-Grams
Francesco D'Angelo, Oguz Kaan Yuksel, Swathi Shree Narashiman +1
Induction heads are attention circuits believed to underlie in-context learning in transformers, yet a precise characterization of the estimators they implement remains elusive. We…
cs.LG2026
Transformers Learn Latent Mixture Models In-Context via Mirror Descent
Francesco D'Angelo, Nicolas Flammarion
Sequence modelling requires determining which past tokens are causally relevant from the context and their importance: a process inherent to the attention layers in transformers, y…