From the 1 of 2 linked papers with an AI index.
1 paper · 1 filter
Jiahe Fan, Yinghao Hou, Si Chen +3
Can large language models with substantially different parameter spaces be merged by direct weighted averaging, without training or semantic alignment? Existing heterogeneous fusio…