Routing Divergence Is Not Evidence of Behavioral Influence in Same-Weight MoE Self-Distillation

Cedric Caruzzo, Donggeun Yoo, Tae Soo Kim

Two Mixture-of-Experts (MoE) forward passes can share every weight yet route the same token through different experts. This creates a possible blind spot in same-weight self-distil…