1 paper · 1 filter
Xiaogeng Liu, Xinyan Wang, Yingzi Ma +2
On-policy self-distillation (OPSD) trains a student on its own rollouts using a privileged teacher, but its standard objective weights all generated tokens equally, implicitly trea…