ConMoE: MoE Compression as Expert Selection and Functional Assignment

Yilun Yao, Jiaming Pan, Elsie Dai +4

Sparse Mixture-of-Experts (MoE) models scale model capacity through sparse activation, but storing their full parameters remains costly in GPU memory. Existing expert compression m…