10 citations · 10 across the 7 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
RL Starts before RL: On Policy Distillation for Better Reinforcement Learning
Shuai Dong, Yongfu Zhu, Yuqi Xu +26
Reinforcement learning (RL) improves reasoning, but its performance depends on the policy from which training begins. We study on-policy distillation (OPD) as a preparation stage f…
cs.LG2026
What Should a Self-Teacher See? Privileged Context Design for On-Policy Self-Distillation
Kanghui Tian, Siyuan Liu, Tianxiang Jiang +8
More privileged information does not always make a better teacher. We study this tension in on-policy self-distillation (OPSD), where a self-teacher scores the student's own rollou…