Model Predictive Control is almost Optimal for Heterogeneous Restless Multi-armed Bandits

Dheeraj Narasimha, Nicolas Gast

We consider a general infinite horizon Heterogeneous Restless multi-armed Bandit (RMAB). Heterogeneity is a fundamental problem for many real-world systems largely because it resis…