1 paper · 1 filter
Tiantian Peng, Guannan Lv, Hongyang Li +5
On-policy distillation (OPD) transfers knowledge from a teacher model to a student along student-generated trajectories, typically by minimizing the reverse Kullback-Leibler (RKL)…