Post-Hoc Merging is Not Enough: Many-Shot Model Merging with Loss-Gap Balancing

Kyungjin Im, Miru Kim, Chanin Eom +1

Model merging has become a practical post-training strategy for building a single multi-task large language model (LLM) by combining multiple task-specialized models. However, most…