Multi-LLM Query Optimization

Arlen Dean, Zijin Zhang, Stefanus Jasin +1

Deploying multiple large language models (LLMs) in parallel to classify an unknown ground-truth label is a common practice, yet the problem of optimally allocating queries across h…