Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs

Yuanyi Wang, Yanggan Gu, Su Lu +7

Model merging efficiently combines specialized large language models (LLMs) without joint retraining, but can substantially alter expert routing in Mixture-of-Experts (MoE) models.…