Lookahead Routing for Large Language Models

Canbin Huang, Tianyuan Shi, Yuhua Zhu +2

Large language model (LLM) routers improve the efficiency of multi-model systems by directing each query to the most appropriate model while leveraging the diverse strengths of het…