1 paper · 2 filters
Kedi Chen, Chen Lin, Yutao Sun +1
On-policy distillation (OPD) bridges teacher supervision and student behavior, but different teacher-student tokenizers introduce misalignment in both input tokenization (#1) and o…