Collapsing Bandits and Their Application to Public Health Interventions

Aditya Mate, Jackson A. Killian, Haifeng Xu +2

We propose and study Collpasing Bandits, a new restless multi-armed bandit (RMAB) setting in which each arm follows a binary-state Markovian process with a special structure: when…