Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
ANO: A Principled Approach to Robust Policy Optimization
Yiheng Zhang, Yiming Wang, Kaiyan Zhao +3
Proximal Policy Optimization (PPO) dominates reinforcement learning and LLM alignment but relies on a "hard clipping" mechanism that discards valuable gradients. Conversely, uncons…
cs.AI2026
Anon: Extrapolating Adaptivity Beyond SGD and Adam
Yiheng Zhang, Kaiyan Zhao, Shaowu Wu +5
Adaptive optimizers such as Adam have achieved great success in training large-scale models like large language models and diffusion models. However, they often generalize worse th…