1 paper · 1 filter
Ming Wen, Yuxuan Liu, Kun Yang +8
On-policy self-distillation (OPSD) has emerged as an efficient post-training paradigm by using a teacher conditioned on privileged information to provide dense token-level supervis…