Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
TV-Regulated OPD: Direction Matters in On-Policy Distillation
Han Xiao, Yifan Niu, Dongyi Liu +2
On-Policy Distillation (OPD) facilitates the transfer of knowledge from domain expert to student in the post-training phase of Large Language Models (LLMs). However, the supervisio…
cs.LG2026
Breaking the Tokenizer Barrier: On-Policy Distillation across Model Families
Yifan Niu, Han Xiao, Dongyi Liu +4
On-Policy Distillation (OPD) has become a core technique in the post-training of Large Language Models (LLMs) for transferring knowledge from domain experts to student models. Howe…