DivMerge: A divergence-based model merging method for multi-tasking

Brahim Touayouch, Loïc Fosse, Géraldine Damnati +1

Multi-task learning (MTL) is often achieved by merging datasets before fine-tuning, but the growing availability of fine-tuned models has led to new approaches such as model mergin…