In-Context Learning with Representations: Contextual Generalization of Trained Transformers

Tong Yang, Yu Huang, Yingbin Liang +1

In-context learning (ICL) refers to a remarkable capability of pretrained large language models, which can learn a new task given a few examples during inference. However, theoreti…