On the Relationship Between the Choice of Representation and In-Context Learning

Ioana Marinescu, Kyunghyun Cho, Eric Karl Oermann

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attribute…