Single-Input Multi-Output Model Merging: Leveraging Foundation Models for Dense Multi-Task Learning

Juan Garcia Giraldo, Nikolaos Dimitriadis, Ke Wang +1

Model merging is a flexible and computationally tractable approach to merge single-task checkpoints into a multi-task model. Prior work has solely focused on constrained multi-task…