A UCB Bandit Algorithm for General ML-Based Estimators

Yajing Liu, Erkao Bao, Linqi Song

We present ML-UCB, a generalized upper confidence bound algorithm that integrates arbitrary machine learning models into multi-armed bandit frameworks. A fundamental challenge in d…