Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation

Chenglei Shen, Haoyang Yao, Weijie Yu +3

On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, reference-based guidance may exp…