Proximal Supervised Fine-Tuning

Wenhong Zhu, Ruobing Xie, Rui Wang +3

Supervised fine-tuning (SFT) of foundation models often leads to poor generalization, where prior capabilities deteriorate after tuning on new tasks or domains. Inspired by trust-r…