2 citations · 3 across the 4 of their papers we have counts for
1 paper · 1 filter
Yilun Liu, Jinru Han, Sikuan Yan +2
Standard Mixture-of-Experts (MoE) models rely on centralized routing mechanisms that introduce rigid inductive biases. We propose Routing-Free MoE which eliminates any hard-coded c…