Lipschitz Bandits without the Lipschitz Constant

Sébastien Bubeck, Gilles Stoltz, Jia Yuan Yu

We consider the setting of stochastic bandit problems with a continuum of arms. We first point out that the strategies considered so far in the literature only provided theoretical…