Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation
Yongliang Miao, Shuang Liu, Yanguang Liu +2
On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even for tokens that the student a…
cs.CL2026
RewardExplainer: Learning Reward Model Explanations from Counterfactual Preference Feedback
Jingyi He, Nier Wu, Shuang Liu +3
Reward models (RMs) are a key component of large language model post-training, providing reward signals for subsequent reinforcement learning. However, conventional discriminative…