Best Arm Identification in Restless Markov Multi-Armed Bandits

P. N. Karthik, Kota Srinivas Reddy, Vincent Y. F. Tan

We study the problem of identifying the best arm in a multi-armed bandit environment when each arm is a time-homogeneous and ergodic discrete-time Markov process on a common, finit…