The mechanistic basis of data dependence and abrupt learning in an in-context classification task

Gautam Reddy

Transformer models exhibit in-context learning: the ability to accurately predict the response to a novel query based on illustrative examples in the input sequence. In-context lea…