1 paper · 1 filter
Jian Luo, Kehan Qi, Qingqiao Hu +5
On-policy distillation (OPD) has attracted growing attention as an effective way to transfer capabilities from teacher models to student models. Recent studies further explore OPD…