Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
OPMD: On-Policy Mechanism Distillation Beyond Output Supervision
Yingdong Shi, Zhihong Li, Changming Li +3
On-policy distillation (OPD) improves language-model by supervising a student on prefixes sampled from its own policy, but its supervision remains confined to the output space. Con…
cs.LG2026
Grad2Reward: From Sparse Judgment to Dense Rewards for Improving Open-Ended LLM Reasoning
Zheng Zhang, Ao Lu, Yuanhao Zeng +5
Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed significant breakthroughs in complex LLM reasoning within verifiable domains, such as mathematics and programmin…