Generalizing the Geometry of Model Merging Through Frechet Averages

Marvin F. da Silva, Mohammed Adnan, Felix Dangel +1

Model merging aims to combine multiple models into one without additional training. Naïve parameter-space averaging can be fragile under architectural symmetries, as their geometry…