SpecDrop: Parameter-Free Category-Conditioned Routing for Modular Specialization

Boyao Wang, Zhihan Lei

Mixture-of-experts (MoE) networks pursue specialization through learned routers, gates, and load-balancing losses, yet at matched total-parameter budgets learned routers can underp…