1 paper · 2 filters
Shuo Yang, Zheyu Zhang, Mahito Sugiyama +1
On-policy distillation (OPD) trains a student on its own rollouts under a frozen teacher, mitigating the distribution mismatch of off-policy supervision. While prior work has prima…