Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing

Ajay Narayanan Sridhar, Ronak Singh, Mehrdad Mahdavi +1

We study contextual bandit problems with correlated arms and access to surrogate reward signals produced by a machine learning model, motivated by applications such as large langua…