1 paper
Yutong Chen, Guangfu Guo, Zhichao Xu +1
On-policy self-distillation (OPSD) uses a privileged copy of the student model to provide dense supervision without an external teacher. OPSD keeps this privileged teacher fixed, e…