Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter Updates

Sanghoon Yu, Min-hwan Oh

We study linear contextual bandits under rare parameter updates: the learner may incorporate reward feedback into its parameter estimate only at a small number of update times, whi…