SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning

Zhongling Xu, Shunan Zheng, Wei Wang

Existing LLM routing frameworks treat queries as independent events, neglecting the sequential nature of real-world user sessions constrained by global computational budgets. This…