2 citations · 2 across the 4 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Softmax Routing Dynamics in Mixture-of-Experts Models: Collapse and Recovery
Shengze Xu, Maolin Deng, Tieyong Zeng
Softmax routing in mixture-of-experts models can concentrate probability on a subset of experts, suppressing access to the others. We study how this concentration forms, why it per…
cs.LG2022
Efficient Private SCO for Heavy-Tailed Data via Averaged Clipping
Chenhan Jin, Kaiwen Zhou, Bo Han +2
We consider stochastic convex optimization for heavy-tailed data with the guarantee of being differentially private (DP). Most prior works on differentially private stochastic conv…