1 paper · 1 filter
Keye Zheng, Hanyu Li, Zhan Cheng +1
On-policy distillation (OPD) pays twice for each fresh batch: the student generates trajectories and a stronger teacher scores them. Existing methods improve which trajectories are…