On the Loss of Context-awareness in General Instruction Fine-tuning

Yihan Wang, Andrew Bai, Nanyun Peng +1

Pre-trained Large Language Models (LLMs) require post-training methods such as supervised fine-tuning (SFT) on instruction-response pairs to enable instruction following. However,…