Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Geometric Routing Enables Causal Expert Control in Mixture of Experts
Ivan Ternovtsii, Yurii Bilak
Sparse Mixture-of-Experts (MoE) models scale parameters while fixing active computation per token, but the specialization of individual experts remains opaque. In a companion paper…
cs.AI2026
Equifinality in Mixture of Experts: Routing Topology Does Not Determine Language Modeling Quality
Ivan Ternovtsii, Yurii Bilak
Sparse Mixture-of-Experts (MoE) architectures employ increasingly sophisticated routing mechanisms -- learned routers, multi-hop trajectories, token-dependent gating. We ask: does…