2 papers
cs.LG2026
Fine-Tuning Dynamics of In-Context Factual Recall in Transformers
Ruomin Huang, Eshaan Nichani, Jason D. Lee +1
In-context learning \ -- performing tasks based on examples given in the prompt \ -- is an important capability that has emerged in large language models and has received significa…
cs.LG2025
Task Diversity Shortens the ICL Plateau
Jaeyeon Kim, Sehyun Kwon, Joo Young Choi +4
In-context learning (ICL) describes a language model's ability to generate outputs based on a set of input demonstrations and a subsequent query. To understand this remarkable capa…