Thinking Short and Right Over Thinking Long: Serving LLM Reasoning Efficiently and Accurately

Yuhang Wang, Youhe Jiang, Bin Cui +1

Recent advances in test-time scaling suggest that Large Language Models (LLMs) can gain better capabilities by generating Chain-of-Thought reasoning (analogous to human thinking) t…