A conversion theorem and minimax optimality for continuum contextual bandits

Arya Akhavan, Karim Lounici, Massimiliano Pontil +1

We study the contextual continuum bandits problem, where the learner sequentially receives a side information vector and has to choose an action in a convex set, minimizing a funct…