Stochastic Contextual Bandits with Graph-based Contexts

Jittat Fakcharoenphol, Chayutpong Prompak

We naturally generalize the on-line graph prediction problem to a version of stochastic contextual bandit problems where contexts are vertices in a graph and the structure of the g…