Dimension Reduction in Contextual Online Learning via Nonparametric Variable Selection

Wenhao Li, Ningyuan Chen, L. Jeff Hong

We consider a contextual online learning (multi-armed bandit) problem with high-dimensional covariate $\mathbf{x}$ and decision $\mathbf{y}$. The reward function to learn, $f(\math…