Learning to Detect an Odd Markov Arm

P. N. Karthik, Rajesh Sundaresan

A multi-armed bandit with finitely many arms is studied when each arm is a homogeneous Markov process on an underlying finite state space. The transition law of one of the arms, re…