Model Reduction Techniques for Computing Approximately Optimal Solutions for Markov Decision Processes

Thomas L. Dean, Robert Givan, Sonia Leach

We present a method for solving implicit (factored) Markov decision processes (MDPs) with very large state spaces. We introduce a property of state space partitions which we call e…