Bandit Problems with Side Observations

Chih-Chun Wang, Sanjeev R. Kulkarni, H. Vincent Poor

An extension of the traditional two-armed bandit problem is considered, in which the decision maker has access to some side information before deciding which arm to pull. At each t…