From Optimal Actions to World Models: Identifiability of Transition Kernels in Discounted MDPs

Neal Batra

We study what can be recovered about the transition probabilities of a Markov decision process from optimal actions alone. This is closely related to the inverse problem considered…