A Time and Space Efficient Algorithm for Contextual Linear Bandits

José Bento, Stratis Ioannidis, S. Muthukrishnan +1

We consider a multi-armed bandit problem where payoffs are a linear function of an observed stochastic contextual variable. In the scenario where there exists a gap between optimal…