Rerouting LLM Routers

Avital Shafran, Roei Schuster, Thomas Ristenpart +1

LLM routers aim to balance quality and cost of generation by classifying queries and routing them to a cheaper or more expensive LLM depending on their complexity. Routers represen…