To update or not to update? Delayed Nonparametric Bandits with Randomized Allocation

Sakshi Arya, Yuhong Yang

Delayed rewards problem in contextual bandits has been of interest in various practical settings. We study randomized allocation strategies and provide an understanding on how the…