Stochastic Multi-armed Bandits in Constant Space

David Liau, Eric Price, Zhao Song +1

We consider the stochastic bandit problem in the sublinear space setting, where one cannot record the win-loss record for all $K$ arms. We give an algorithm using $O(1)$ words of s…