Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing

Guannan Lai, Gelin Bian, Hao-Xuan Ma +5

Large language model (LLM) routing reduces serving cost by assigning each query to an appropriate model while preserving response quality. Learning such a router, however, often re…