Model Merging on Loss Landscape: A Geometry Perspective

Juanwu Lu, Anand Bhaskar, Brian Axelrod +2

Model merging offers a promising avenue for knowledge integration and parallel development without retraining. Yet, existing methods either ignore the geometry of the loss landscap…