Exploring Offline Policy Evaluation for the Continuous-Armed Bandit Problem

Jules Kruijswijk, Petri Parvinen, Maurits Kaptein

The (contextual) multi-armed bandit problem (MAB) provides a formalization of sequential decision-making which has many applications. However, validly evaluating MAB policies is ch…