Preserving General Capabilities during Domain Specialization with Uncertainty-Calibrated MOPD

Ziyuan Liu, Jiao Ou, Jian Liang +2

Specializing large language models to vertical domains improves domain-specific behavior but often degrades general capabilities such as reasoning, coding, instruction following, a…