Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning

Xuanzhi Feng, Zhengyang Li, Zeyu Liu +6

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced Large Language Model (LLM) reasoning; however, it faces a fundamental optimization instability: uni…