Bayesian Algorithms for Adversarial Online Learning: from Finite to Infinite Action Spaces

Alexander Terenin, Jeffrey Negrea

We develop a form Thompson sampling for online learning under full feedback - also known as prediction with expert advice - where the learner's prior is defined over the space of a…