A characterization of sample adaptivity in UCB data

Yilun Chen, Jiaqi Lu

We characterize a joint CLT of the number of pulls and the sample mean reward of the arms in a stochastic two-armed bandit environment under UCB algorithms. Several implications of…