Self-Specialized Teachers for Domain Post-Training

Yifei Li, Rongman Xu, Lingling Zhang +5

Target-only post-training can improve performance in a specialized domain while degrading behaviors that a general-purpose base model acquired before adaptation. We study this prob…