Valid Post-Contextual Bandit Inference

Ramon van den Akker, Bas J. M. Werker, Bo Zhou

We establish an asymptotic framework for the statistical analysis of the stochastic contextual multi-armed bandit problem (CMAB), which is widely employed in adaptively randomized…