2 papers
cs.LG2026
Training-Free Knowledge Transfer Across Model Scales through Activation-Guided Pruning
Jiahe Fan, Si Chen, Yinghao Hou +2
Heterogeneous model fusion seeks to combine models that differ in tasks, initializations, architectures, or scales. We study an underexplored cross-scale setting: improving a small…
cs.AI2026
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
Jiahe Fan, Yinghao Hou, Si Chen +3
Can large language models with substantially different parameter spaces be merged by direct weighted averaging, without training or semantic alignment? Existing heterogeneous fusio…