Nonparametric Contextual Bandits in an Unknown Metric Space

Nirandika Wanigasekara, Christina Lee Yu

Consider a nonparametric contextual multi-arm bandit problem where each arm $a\in [K]$ is associated to a nonparametric reward function $f_a:[0,1]\to \mathbb{R}$ mapping from co…