Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Distributionally Robust Mixture-of-Experts Training
Xin Teng, Muxiao Li, Hongyi Wen
Mixture-of-Experts (MoE) transformers scale capacity by activating only a few experts per token, but this sparsity creates a hidden reliability problem: when routing is imperfect,…
cs.LG2025
From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle Velocity
Haoming Liu, Jinnuo Liu, Yanhao Li +5
Flow-based diffusion models have emerged as a leading paradigm for training generative models across images and videos. However, their memorization-generalization behavior remains…