1 citations · 3 across the 8 of their papers we have counts for
1 paper · 1 filter
Yecheng Wu, Song Han, Han Cai
On-policy distillation (OPD) provides dense token-level supervision from a teacher, but its effectiveness can depend on teacher consistency, meaning that the model providing OPD su…