1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Anzhe Cheng, Shukai Duan, Shixuan Li +8
Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's inter…