Neural Bandit Based Optimal LLM Selection for a Pipeline of Subtasks

Baran Atalar, Eddie Zhang, Carlee Joe-Wong

As large language models (LLMs) become increasingly popular, there is a growing need to predict which out of a set of LLMs will yield a successful answer to a given query at low co…