Trust Is Not Enough: Influence Calibration for On-Policy Self-Distillation in Agentic RL

Qizhen Lan, Xi Xiao, Xiangchen Guan +4

On-policy self-distillation (OPSD) gives language agents dense token-level supervision from a privileged self-teacher on the policy's own trajectories. Existing methods allocate th…