1 paper
Jiacheng Du, Weiwei Xie, Tianyi Du +3
On-policy self-distillation (OPSD) trains a question-only student with token-level feedback from a teacher given training-only privileged information (PI). OPSD therefore provides…