UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models

Lei Xin, Bin Gu, Peize Li +9

Sparse mixture-of-experts (MoE) layers expand recommendation capacity through conditional computation, yet a trained checkpoint still stores and routes over its full expert bank. W…