PAST: Privileged Adaptation from Complete Student Trajectories for On-Policy Self-Distillation

Yangyang Feng, Zhuoyan Feng, Junlan Chen

On-policy self-distillation (OPSD) uses a privileged teacher to supervise a reasoning model on prefixes sampled from its own rollouts. Yet each rollout also reveals how the student…