The Alchemy of Thought: Understanding In-Context Learning Through Supervised Classification

Harshita Narnoli, Mihai Surdeanu

In-context learning (ICL) has become a prominent paradigm to rapidly customize LLMs to new tasks without fine-tuning. However, despite the empirical evidence of its usefulness, we…