2 papers
cs.CL2026
Exploring Heterogeneous Model Merging Approach for Complex Knowledge Transfer
Jiahe Fan, Si Chen, Yinghao Hou +4
Specialized models encode task-oriented behavior, but transferring that behavior to a general language model usually requires training, distillation, or representation alignment. W…
cs.AI2026
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
Jiahe Fan, Yinghao Hou, Si Chen +3
Can large language models with substantially different parameter spaces be merged by direct weighted averaging, without training or semantic alignment? Existing heterogeneous fusio…