What You See May Not Be What You Get: UCB Bandit Algorithms Robust to ε-Contamination

Laura Niss, Ambuj Tewari

Motivated by applications of bandit algorithms in education, we consider a stochastic multi-armed bandit problem with $\epsilon$-contaminated rewards. We allow an adversary to g…