Indexability of Restless Bandit Problems and Optimality of Whittle's Index for Dynamic Multichannel Access

Keqin Liu, Qing Zhao

We consider a class of restless multi-armed bandit problems (RMBP) that arises in dynamic multichannel access, user/server scheduling, and optimal activation in multi-agent systems…