1.2k citations · 2.2k across the 46 of their papers we have counts for
1 paper · 2 filters
Itay Lavie, Kirsten Fischer, Andrey Lekov +3
Attention is the key mechanism underlying in-context learning in transformers, and attention patterns have been observed empirically to emerge abruptly during training. We present…