Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
AMO: Operator-level Adaptive Muon Orthogonalization
Xinlin Zhuang, Panyi Ouyang, Yichen Li +7
Muon has recently emerged as a competitive alternative to AdamW for large-scale pre-training, with orthogonalization via Newton-Schulz (NS) iteration as its core operation. Standar…
cs.LG2025
ESPO: Entropy Importance Sampling Policy Optimization
Yuepeng Sheng, Yuwei Huang, Shuman Liu +2
Reinforcement learning (RL) has become a central component of post-training for large language models (LLMs), particularly for complex reasoning tasks that require stable optimizat…