1 paper
Zhou Ziheng, Jiaqi Li, Huacong Tang +2
On-policy distillation has recently emerged as a promising alternative to standard sequence-level imitation, training a student by scoring its own rollouts with a teacher model. Ho…