Model Merging by Output-Space Projection

Bethan Evans, Benjamin Etheridge, Stephen Roberts +1

Model merging combines fine-tuned checkpoints into a single multi-task model without retraining. Existing methods - such as task arithmetic, model soups, TIES, and DARE - are compu…