FlexRouter: Learning Complementary Model Sets for Flexible LLM Routing

Wang Wei, Harry Yang, Tiankai Yang +6

Existing Large Language Model (LLM) routing methods score LLMs independently to select top-$k$ models. However, this ignores model correlations and enforces a rigid computational b…