What Should SFT Learn? Conditional Information Gain for Generalizable Post-Training

Yuxuan Gu, Kequan Niu, Xiaocheng Feng +3

Supervised fine-tuning (SFT) remains a widely used approach for post-training large language models, because fixed demonstrations can directly introduce desired reasoning strategie…