STAR: Spectral Truncation and Rescale for Model Merging

Yu-Ang Lee, Ching-Yun Ko, Tejaswini Pedapati +3

Model merging is an efficient way of obtaining a multi-task model from several pretrained models without further fine-tuning, and it has gained attention in various domains, includ…