Which LLM to pick? Online Active Model Selection for Large Language Models

Alessandro Turrin, Patrik Okanovic, Torsten Hoefler +1

Large Language Models (LLMs) are increasingly applied to process streaming data, with practitioners relying on benchmarks to select the best model even though these signals only ap…