Predictive Scheduling for Efficient Inference-Time Reasoning in Large Language Models

Katrina Brown, Aneesh Muppidi, Rana Shahout

Large language models (LLMs) achieve state-of-the-art accuracy on complex reasoning tasks by generating multiple chain-of-thought (CoT) traces, but using a fixed token budget per q…