Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems

Heming Fu, Shan Lin, Qianqian Xie +1

When a language model fails to answer a query on the first attempt, an agentic system retries, consuming additional tokens each time. This retry overhead creates a gap between what…