Bandits with many optimal arms

Rianne de Heide, James Cheshire, Pierre Ménard +1

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^{\ast }$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal…