On the Token Value Inequality in Efficient Reasoning

Runjia Zeng, Hang Hua, Yiyang Liu +5

Chain-of-Thought reasoning has enabled large language models to achieve substantial performance gains on complex tasks. However, these gains come at the cost of dramatically increa…