Pandora's AI Model Routing Box: Efficient Allocation with Costly Value Estimation

Adam Fisch, Shubhendu Trivedi, Fantine Huot +5

Heterogeneous AI systems composed of multiple models, architectures, harnesses, or inference-time settings can improve quality and efficiency by routing queries to the specialist w…