Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought

Ching-Chieh Tsao, Zhuoyi Lin, Wenya Wang

Mixture-of-Experts architectures have revolutionized scaling, yet the underlying logic of their routing remains a black box. In this paper, we uncover a fundamental governing princ…