14 citations · 21 across the 8 of their papers we have counts for
1 paper · 1 filter
Éric Jacopin
When do transformers commit to a decision, and what prevents them from correcting it? We introduce prolepsis: a transformer commits early, task-specific attention heads sustain the…