MOMA: Masked Orthogonal Matrix Alignment for Zero-Additional-Parameter Model Merging

Fanshuang Kong, Richong Zhang, Zhijie Nie +4

Model merging offers a scalable alternative to multi-task learning but often yields suboptimal performance on classification tasks. We attribute this degradation to a geometric mis…