1 paper · 1 filter
Yutong Chen, Guangfu Guo, Zhichao Xu +1
On-policy self-distillation (OPSD) combines student generated trajectories with dense supervision from a privileged teacher of the same model. Its pointwise clipping protects the s…