Pessimism for Offline Linear Contextual Bandits using ${\ell }_p$ Confidence Sets

Gene Li, Cong Ma, Nathan Srebro

We present a family $\{\hat{\pi }{\}}_{p\ge 1}$ of pessimistic learning rules for offline learning of linear contextual bandits, relying on confidence sets with respect to different $\ell…