2 papers
cs.LG2026
Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
Bingxi Hou, Guochao Jiang, Guofeng Quan +4
Policy-shift distillation reuses the difference between a teacher's log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories.…
cs.CL2026
Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability
Bingxi Hou, Guochao Jiang, Guofeng Quan +4
On-Policy Distillation (OPD) trains a student on its own generations using teacher feedback. With different tokenizers, comparing teacher and student predictions requires alignment…