Showing cs.AIShow all
3 papers · 1 filter
cs.AI2026
OPDSearch+: On-Policy Distillation with RL Refinement for Search-Augmented Reasoning
Qinglin Ye, Zhiyuan Gu, Jingjie Xia +6
Search-augmented reasoning remains difficult for small language models. On-policy distillation (OPD) from trained teachers offers a promising direction, but suffers from two issues…
cs.AI2026
ANO: Robust Policy Optimization via Bounded, Redescending Gain Fields
Yiheng Zhang, Yiming Wang, Kaiyan Zhao +3
Proximal Policy Optimization (PPO) dominates reinforcement learning and LLM alignment, yet its hard-clipping mechanism and unconstrained alternatives (e.g., SPO) sit at two extreme…
cs.AI2026
Anon: Extrapolating Adaptivity Beyond SGD and Adam
Yiheng Zhang, Kaiyan Zhao, Shaowu Wu +5
Adaptive optimizers such as Adam and non-adaptive methods like SGD exhibit distinct generalization capabilities across different architectures. Prior tunable optimizers attempt to…