M-Loss: Quantifying Model Merging Compatibility with Limited Unlabeled Data

Tiantong Wang, Yiyang Duan, Haoyu Chen +2

Training of large-scale models is both computationally intensive and often constrained by the availability of labeled data. Model merging offers a compelling alternative by directl…