Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation

Bingxi Hou, Guochao Jiang, Guofeng Quan +4

Policy-shift distillation reuses the difference between a teacher's log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories.…