1 paper · 1 filter
Zichao Yu, Qianshuo Ye, Xu Wang +1
On-policy distillation (OPD) is a widely adopted post-training technique for LLM reasoning. It is commonly believed to transfer knowledge from a stronger teacher, yet what OPD actu…