2 papers
cs.AI2026
Solving Without Stopping: On-Policy Distillation at Small Scale
Hongyang Li, Yiming Zhu, Xiao Li +3
On-policy distillation, where a student learns from a stronger teacher's feedback on its own outputs, is a common way to pass reasoning to smaller models. We analyze what it transf…
cs.LG2026
Beyond Compression: Diagnosing How Post-Training Changes Mathematical Reasoning
Hongyang Li, Yiming Zhu, Xiao Li +3
Post-training is central to mathematical reasoning in modern large language models (LLMs), but endpoint pass@1 alone underidentifies what has changed. Gains may reflect newly reach…