Revisiting In-Context Learning with Long Context Language Models

Jinheon Baek, Sun Jae Lee, Prakhar Gupta +3

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed…