Learning to Detect an Odd Restless Markov Arm with a Trembling Hand

P. N. Karthik, Rajesh Sundaresan

This paper studies the problem of finding an anomalous arm in a multi-armed bandit when (a) each arm is a finite-state Markov process, and (b) the arms are restless. Here, anomaly…