Self-Tuning Bandits over Unknown Covariate-Shifts

Joseph Suk, Samory Kpotufe

Bandits with covariates, a.k.a. contextual bandits, address situations where optimal actions (or arms) at a given time $t$, depend on a context $x_t$, e.g., a new patient's medical…