Ability Transfer and Recovery via Modularized Parameters Localization

Songyao Jin, Kun Zhou, Wenqi Li +2

Large language models can be continually pre-trained or fine-tuned to improve performance in specific domains, languages, or skills, but this specialization often degrades other ca…