Closed-Form Spectral Regularization for Multi-Task Model Merging

Yongxian Wei, Runxi Cheng, Xingxuan Zhang +4

Model merging combines several independently fine-tuned experts into a single multi-task model without any training data, reducing the storage, serving, and decentralized-developme…