paper

The Value Functions of Markov Decision Processes

arXiv:1511.02377

Abstract

We provide a full characterization of the set of value functions of Markov decision processes.