1 paper
Guhan Chen, Bohan Li, Jun Rao +8
On-policy distillation trains a student on its own rollouts, so states the teacher would reach but the student does not are seldom supervised. We introduce CoRD (coupled-rollout di…