Decom-Renorm-Merge: Model Merging on the Right Space Improves Multitasking

Yuatyong Chaichana, Thanapat Trachu, Peerat Limkonchotiwat +3

In the era of large-scale training, model merging has evolved into a tool for creating multitasking models efficiently. It enables the knowledge of models to be fused, without the…