Dapeng Wu

works on

entropy preservation 1 large language models 1 reinforcement learning 1 self-distillation 1 supervised fine-tuning 1

From the 1 of 2 linked papers with an AI index.

collaborators

Showing cs.LGShow all

1 paper · 1 filter

cs.LG2026

Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models

Hao Wang, Hao Gu, Hongming Piao +6

The paper introduces CurioSFT, an entropy-preserving supervised fine-tuning approach that uses adaptive self-distillation to keep exploration abilities in large reasoning models, l…