Simulation Based Algorithms for Markov Decision Processes and Multi-Action Restless Bandits

Rahul Meshram, Kesav Kaza

We consider multi-dimensional Markov decision processes and formulate a long term discounted reward optimization problem. Two simulation based algorithms---Monte Carlo rollout poli…