Thompson Sampling for Parameterized Markov Decision Processes with Uninformative Actions

Michael Gimelfarb, Michael Jong Kim

We study parameterized MDPs (PMDPs) in which the key parameters of interest are unknown and must be learned using Bayesian inference. One key defining feature of such models is the…