36 citations · 37 across the 12 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
ORCA: The Annealed Spectral Conditioning Optimizer for Faster, Better LLM Training
Yuanshi Liu, Boyuan Jiang, Liang Hou +4
Modern LLM optimizers such as Muon often produce weight matrices with higher effective rank than Adam, yet further spectral control has delivered only modest gains. We identify a t…
cs.LG2025
Score Augmentation for Diffusion Models
Liang Hou, Yuan Gao, Boyuan Jiang +6
Diffusion models have achieved remarkable success in generative modeling. However, this study confirms the existence of overfitting in diffusion model training, particularly in dat…