Calibrating Teacher--Student Discrepancy for On-Policy Distillation

Qiangqiang He, Jin Li, MingCai Chen

On-policy distillation (OPD) improves reasoning models by learning the token-level discrepancy between a stronger teacher and an on-policy student. However, this discrepancy does n…