From Parameter to Representation: A Closed-Form Approach for Controllable Model Merging

Jialin Wu, Jian Yang, Handing Wang +2

Model merging combines expert models for multitask performance but faces challenges from parameter interference. This has sparked recent interest in controllable model merging, giv…