Signature-Guided Capacity Occupancy for Dense Expert Merging

Lingching Tung, Chi-Jui Kim, Beicheng Xu +2

Dense expert merging combines domain-specialized language models into one single checkpoint, typically by admitting task-vector support in weight space. However, this admission is…