Thompson sampling with the online bootstrap

Dean Eckles, Maurits Kaptein

Thompson sampling provides a solution to bandit problems in which new observations are allocated to arms with the posterior probability that an arm is optimal. While sometimes easy…