1 paper · 1 filter
Dongze Hao, Zhiwei Jin, Chen Chen +1
On-policy distillation (OPD) has recently emerged as an important post-training paradigm. By using a stronger teacher model to provide dense, fine-grained supervision for sampled t…