Explore Briefly, Then Decide: Mitigating LLM Overthinking via Cumulative Entropy Regulation

Yi Bin, Tianyi Jiang, Yujuan Ding +5

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities on complex problems using long Chain-of-Thought (CoT) reasoning. However, they often suffer from overt…