1 paper · 1 filter
Siming Fu, Zheming Fu, Ruizhe He +7
On-policy distillation, in which a teacher corrects samples that the student itself generates, presupposes that the two models speak the same language: identical VAE latents, match…