4 papers · 1 filter
Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing
Guannan Lai, Gelin Bian, Hao-Xuan Ma +5
Large language model (LLM) routing reduces serving cost by assigning each query to an appropriate model while preserving response quality. Learning such a router, however, often re…
Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing
Guannan Lai, Han-Jia Ye
Large language model (LLM) routing aims to assign each query to the most suitable model from a heterogeneous candidate pool, improving the quality--efficiency trade-off of LLM infe…
When Routing Collapses: On the Degenerate Convergence of LLM Routers
Guannan Lai, Han-Jia Ye
LLM routing aims to achieve a favorable quality--cost trade-off by dynamically assigning easy queries to smaller models and harder queries to stronger ones. However, across both un…
MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing
Haoxuan Ma, Guannan Lai, Han-Jia Ye
Multimodal large language models (MLLMs) have advanced rapidly, yet heterogeneity in architecture, alignment strategies, and efficiency means that no single model is uniformly supe…