Same Trajectory, Different Knowledge: Information-State-Aware On-Policy Distillation for Search Agents

Minhao Sun, Xian-Ling Mao, Eric Tao +2

On-policy distillation trains search agents with teacher feedback on student-generated trajectories. Recent methods augment the teacher's context with supporting evidence, referenc…