Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
DASH-OPD: Discrepancy-Aware Switching with Hysteresis for On-Policy Distillation
Yuchen Xia, Qianguo Sun, Chao Song +3
On-policy distillation (OPD) trains student models on their own rollouts to reduce exposure bias. However, in multi-turn agent scenarios, early student errors can lead a trajectory…
cs.LG2026
Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe
Xixi Wu, Qianguo Sun, Ruiyang Zhang +4
Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in…
cs.LG2025
Linear Preference Optimization: Decoupled Gradient Control via Absolute Regularization
Rui Wang, Qianguo Sun, Chao Song +4
DPO (Direct Preference Optimization) has become a widely used offline preference optimization algorithm due to its simplicity and training stability. However, DPO is prone to overf…