1 paper · 1 filter
Xin Li, Hao Jiang, Annan Wang +2
A distilled student can copy its teacher's mistakes along with its skills. On-policy distillation (OPD), used in recent post-training recipes, has the teacher grade every token of…