Rethinking Expert Training for Model Merging with Prompt Learning

Christos Georgakilas, Aniello Panariello, Samir El Karrat Moreno +3

Model merging aims to combine multiple domain-specialized experts trained from a shared foundation model into a single multi-task model. Existing approaches largely focus on improv…