Partition Tree Weighting for Non-Stationary Stochastic Bandits

Joel Veness, Marcus Hutter, Andras Gyorgy +1

This paper considers a generalisation of universal source coding for interaction data, namely data streams that have actions interleaved with observations. Our goal will be to cons…