3 papers
cs.LG2026
DemoPSD: Disagreement-Modulated Policy Self-Distillation
Yunhe Li, Hao Shi, Wenhao Liu +5
On-policy self-distillation (OPSD) has emerged as a practical method for training large language models (LLMs) to reason, where a single model acts as both the teacher and the stud…
cs.AI2026
Learning to Reason with Insight for Informal Theorem Proving
Yunhe Li, Hao Shi, Bowen Deng +8
Although most of the automated theorem-proving approaches depend on formal proof systems, informal theorem proving can align better with large language models' (LLMs) strength in n…
cs.LG2026
Placing Puzzle Pieces Where They Matter: A Question Augmentation Framework for Reinforcement Learning
Yangyi Fang, Jiaye Lin, Xiaoliang Fu +2
Reinforcement learning has become a powerful approach for enhancing large language model reasoning, but faces a fundamental dilemma: training on easy problems can cause overfitting…