9 citations · 10 across the 8 of their papers we have counts for
1 paper · 1 filter
Shutong Wu, Xiwen Chen, Brendan Rappazzo +4
On-policy distillation (OPD) trains a student model on its self-generated trajectories with dense token-level teacher feedback. However, naive OPD may suffer from teacher unanchori…