Beyond the Teacher: Understanding and Preserving Distillation Overshoot in Agentic On-Policy Distillation

Jike Zhong, Ming Li, Yuxiang Lai +9

On-policy distillation (OPD) trains agents on their own trajectories using supervision from a stronger teacher. We uncover a counterintuitive phenomenon in multi-turn agentic tasks…