Learning to Recover Task Experts from a Multi-Task Merged Model

Jinwook Jung, Taegyu Kim, Kumju Jo +1

Multi-task model merging aims to consolidate several task-specific experts into a unified model, yet static merging consistently suffers from parameter interference. While dynamic…