CARGO: A Framework for Confidence-Aware Routing of Large Language Models

Amine Barrak, Yosr Fourati, Michael Olchawa +2

As large language models (LLMs) proliferate in scale, specialization, and latency profiles, the challenge of routing user prompts to the most appropriate model has become increasin…