1 citations · 1 across the 2 of their papers we have counts for
1 paper · 2 filters
Qingyuan Zheng, Zhihao Dou
Knowledge distillation improves a student model's reasoning ability through supervision from a teacher. On-policy self-distillation (OPSD) uses the same model as both teacher and s…