Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
DASH-OPD: Discrepancy-Aware Switching with Hysteresis for On-Policy Distillation
Yuchen Xia, Qianguo Sun, Chao Song +3
While on-policy distillation (OPD) reduces exposure bias by training student language models on their own rollouts, early student errors in long-horizon agentic scenarios can lead…
cs.LG2026
Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe
Xixi Wu, Qianguo Sun, Ruiyang Zhang +4
Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in…
cs.LG2025
Linear Preference Optimization: Decoupled Gradient Control via Absolute Regularization
Rui Wang, Qianguo Sun, Chao Song +4
DPO (Direct Preference Optimization) has become a widely used offline preference optimization algorithm due to its simplicity and training stability. However, DPO is prone to overf…