Re-examining learning linear functions in context

Omar Naim, Guilhem Fouilhé, Nicholas Asher

In-context learning (ICL) has emerged as a powerful paradigm for easily adapting Large Language Models (LLMs) to various tasks. However, our understanding of how ICL works remains…