3 papers
cs.LG2025
Proximal Supervised Fine-Tuning
Wenhong Zhu, Ruobing Xie, Rui Wang +3
Supervised fine-tuning (SFT) of foundation models often leads to poor generalization, where prior capabilities deteriorate after tuning on new tasks or domains. Inspired by trust-r…
cs.CL2025
Flexible Realignment of Language Models
Wenhong Zhu, Ruobing Xie, Weinan Zhang +1
Realignment becomes necessary when a language model (LM) fails to meet expected performance. We propose a flexible realignment framework that supports quantitative control of align…
cs.CL2025
Adding Alignment Control to Language Models
Wenhong Zhu, Weinan Zhang, Rui Wang
Post-training alignment has increasingly become a crucial factor in enhancing the usability of language models (LMs). However, the strength of alignment varies depending on individ…