2 papers
cs.LG2026
Denoise First, Orthogonalize Later: Understanding Momentum in Muon via Spectral Filtering
Xianliang Li, Zihan Zhang, Weiyang Liu +1
Muon has recently demonstrated strong empirical performance in large language model training, but the theoretical role of momentum in Muon remains unclear. Existing analyses of Muo…
cs.CV2026
Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition
Pengyang Ling, Jiazi Bu, Yujie Zhou +6
Group Relative Policy Optimization(GRPO) has emerged as an effective paradigm for aligning flow-based generative models with human preferences. However, the high cost of group roll…