Unified theory of upper confidence bound policies for bandit problems targeting total reward, maximal reward, and more

Nobuaki Kikkawa, Hiroshi Ohno

The upper confidence bound (UCB) policy is recognized as an order-optimal solution for the classical total-reward bandit problem. While similar UCB-based approaches have been appli…