Showing math.OCShow all
2 papers · 1 filter
math.OC2025
A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models
X. Y. Han, Yuan Zhong
In large-scale AI training, Sparse Mixture-of-Experts (s-MoE) layers enable scaling by activating only a small subset of experts per token. An operational challenge in this design…
math.OC2020
Disk matrices and the proximal mapping for the numerical radius
X. Y. Han, Adrian S. Lewis
Optimal matrices for problems involving the matrix numerical radius often have fields of values that are disks, a phenomenon associated with partial smoothness. Such matrices are h…