1 citations · 1 across the 1 of their papers we have counts for
1 paper · 1 filter
Xidong Wu, Qi Qi, Yuqiong Ji +1
Unlike on-policy distillation (OPD), which depends on a separate teacher model, on-policy self-distillation (OPSD) leverages a single language model acting simultaneously as the st…