When Context Sticks: Studying Interference in In-Context Learning

Hanna Rød, Dagny Streit, Nils Valseth Selte +1

This paper investigates context stickiness in in-context learning (ICL), a phenomenon where earlier examples in a prompt interfere with a transformer's ability to adapt to later ta…