Showing 2026Show all
2 papers · 1 filter
cs.CL2026
Step-Level On-Policy Distillation: Interpolating Between On-Policy Distillation and Supervised Fine-Tuning
Changhui Sun, Lanbo Liu, Hang Lei +11
On-policy distillation (OPD) aligns a student model with a teacher's logit distribution on student-generated trajectories. This approach has achieved strong empirical gains and can…
cs.AI2026
Rewarding Creativity: A Human-Aligned Generative Reward Model for Reinforcement Learning in Storytelling
Zhaoyan Li, Hang Lei, Yujia Wang +3
While Large Language Models (LLMs) can generate fluent text, producing high-quality creative stories remains challenging. Reinforcement Learning (RL) offers a promising solution bu…