Graph-Conditioned On-Policy Agent Distillation from Off-the-Shelf Teachers

Xiaohan Yi, Wen Luo, Yani Huang +4

On-policy distillation (OPD) trains compact language agents with teacher feedback on student-generated trajectories. In multi-turn tasks, compounding errors can move students beyon…