Hindsight Compacts but Does Not Repair: Rethinking On-Policy Self-Distillation in Reasoning Models

Jaehoon Kim, Dongha Lee

On-Policy Self-Distillation (OPSD) has emerged as a promising post-training method: requiring only privileged context, it enables token-level credit assignment from a self-teacher…