Detecting an Odd Restless Markov Arm with a Trembling Hand

P. N. Karthik, Rajesh Sundaresan

In this paper, we consider a multi-armed bandit in which each arm is a Markov process evolving on a finite state space. The state space is common across the arms, and the arms are…