26 citations · 26 across the 6 of their papers we have counts for
1 paper · 1 filter
Yongkang Yang, Zhezheng Hao, Hong Zhang +8
On-policy self-distillation (OPSD) improves the reasoning abilities of LLMs by internalizing privileged context into model parameters through self-distillation. Two recent research…