Parameter-Efficient Interventions for Enhanced Model Merging

Marcin Osial, Daniel Marczak, Bartosz Zieliński

Model merging combines knowledge from task-specific models into a unified multi-task model to avoid joint training on all task data. However, current methods face challenges due to…