Model Assembly Learning with Heterogeneous Layer Weight Merging

Yi-Kai Zhang, Jin Wang, Xu-Xiang Zhong +2

Model merging acquires general capabilities without extra data or training by combining multiple models' parameters. Previous approaches achieve linear mode connectivity by alignin…