1 paper · 2 filters
Siqi Zhu, Xuyan Ye, Hongyu Lu +2
On-policy distillation (OPD) and on-policy self-distillation (OPSD) have emerged as promising post-training methods for large language models, offering dense token-level supervisio…