Dynamic LLM Routers are Often Misguided

Sam Wang, Julia White, Sahibzada Allahyar +3

Dynamic LLM routers promise to cut inference costs by sending each query to the cheapest model that can answer it correctly. We analyze six commercial routers across 14 settings on…