Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Training-Free On-Policy Distillation
Bangji Yang, Jiajun Fan, Zhaoyu Zhu +2
On-policy distillation consolidates specialist models into one student at the price of rollouts, teacher passes and gradient steps for every teacher. We show that the consolidation…
cs.LG2026
Batched Contextual Reinforcement: A Task-Scaling Law for Efficient Reasoning
Bangji Yang, Hongbo Ma, Jiajun Fan +1
Large Language Models employing Chain-of-Thought reasoning achieve strong performance but suffer from excessive token consumption that inflates inference costs. Existing efficiency…