Discounted Thompson Sampling for Non-Stationary Bandit Problems

Han Qi, Yue Wang, Li Zhu

Non-stationary multi-armed bandit (NS-MAB) problems have recently received significant attention. NS-MAB are typically modelled in two scenarios: abruptly changing, where reward di…