A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router

O. M. Kiselev

We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforc…