1 citations · 1 across the 16 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
CompassOPD: Cross-Family On-Policy Distillation via Within-Family Likelihood Shifts
Naibin Gu, Qingyi Si, Chenxu Yang +5
On-policy distillation (OPD) provides dense token-level supervision on student-generated trajectories. Although OPD performs strongly when teacher and student belong to the same mo…
cs.LG2026
Co-Evolving Policy Distillation
Naibin Gu, Chenxu Yang, Qingyi Si +7
RLVR and OPD have become standard paradigms for post-training. We provide a unified analysis of these two paradigms in consolidating multiple expert capabilities into a single mode…
cs.LG2026
Self-Distilled RLVR
Chenxu Yang, Chuanyu Qin, Qingyi Si +7
On-policy distillation (OPD) has become a popular training paradigm in the LLM community. This paradigm selects a larger model as the teacher to provide dense, fine-grained signals…