The Gittins Index for a Transparent One-Armed Bandit with a Continuous Payoff Spectrum in Equilibrium States

Marcin Makowski, Edward W. Piotrowski, Jan L. Cieśliński

We present an analogue of the classical Gittins index for a one-armed decision problem with a continuous spectrum of payoffs. The model assumes that the decision-maker observes ind…