The Learnability of In-Context Learning

Noam Wies, Yoav Levine, Amnon Shashua

In-context learning is a surprising and important phenomenon that emerged when modern language models were scaled to billions of learned parameters. Without modifying a large langu…