Sliding-Window Thompson Sampling for Non-Stationary Settings

Marco Fiandri, Alberto Maria Metelli, Francesco Trovò

Non-stationary multi-armed bandits (NS-MABs) model sequential decision-making problems in which the expected rewards of a set of actions, a.k.a.~arms, evolve over time. In this pap…