UOPD: Uncertainty-Aware Intervention for On-Policy Distillation of Multi-Turn Agents

Wenbo Zhang, Pengcheng Xu, Weizhi Du +2

On-policy distillation (OPD) trains a student on its own rollouts using dense supervision from a teacher. In multi-turn environments, a mistake at a critical decision step can redi…