Towards Generalized Routing: Model and Agent Orchestration for Adaptive and Efficient Inference

Xiyu Guo, Shan Wang, Chunfang Ji +6

The rapid advancement of large language models (LLMs) and domain-specific AI agents has greatly expanded the ecosystem of AI-powered services. User queries, however, are highly div…