2 papers
cs.LG2026
CoRD: Coupled Rollouts Fill the Blind Spot of On-Policy Distillation
Guhan Chen, Bohan Li, Jun Rao +8
On-policy distillation trains a student on its own rollouts, so states the teacher would reach but the student does not are seldom supervised. We introduce CoRD (coupled-rollout di…
cs.CL2026
DIAG: Diagnostic Iterative Alignment and Generation for Data-Efficient Mathematical Preference Distillation
Guhan Chen, Songtao Tian, Bohan Li +3
Iterative preference optimization is essential for aligning Large Language Models on mathematical reasoning tasks, yet its efficiency is often throttled by signal scarcity: as the…