Emergence of Context Characteristics Sensitivity in Large Language Models

Nadya Yuki Wangsajaya, Haeun Yu, Isabelle Augenstein

During instruction fine-tuning (IFT), large language models (LLMs) learn to follow instructions by using the provided context to answer a query. While prior work has studied how co…