2 citations · 7 across the 19 of their papers we have counts for
1 paper · 2 filters
O. M. Kiselev
We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforc…