1 paper
Yuchen Li, Mingyu Du, Zongqi Fan +2
Sparse expert models can distribute traffic evenly while still grouping incompatible training signals within the same experts. We study routing as a gradient-partitioning problem a…