PickLLM: Context-Aware RL-Assisted Large Language Model Routing

Dimitrios Sikeridis, Dennis Ramdass, Pranay Pareek

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g.…