entropy preservation 1large language models 1reinforcement learning 1self-distillation 1supervised fine-tuning 1
From the 1 of 21 linked papers with an AI index.
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models
Hao Wang, Hao Gu, Hongming Piao +6
The paper introduces CurioSFT, an entropy-preserving supervised fine-tuning approach that uses adaptive self-distillation to keep exploration abilities in large reasoning models, l…
cs.LG2026
FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning
Yujie Feng, Hao Wang, Jian Li +6
Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting. Memory replay methods are widely used for…
cs.LG2025
Loong: Synthesize Long Chain-of-Thoughts at Scale through Verifiers
Xingyue Huang, Rishabh, Gregor Franke +43
Recent advances in Large Language Models (LLMs) have shown that their reasoning capabilities can be significantly improved through Reinforcement Learning with Verifiable Reward (RL…