Weighted mesh algorithms for general Markov decision processes: Convergence and tractability

Denis Belomestny, John Schoenmakers

We introduce a mesh-type approach for tackling discrete-time, finite-horizon Markov Decision Processes (MDPs) characterized by state and action spaces that are general, encompassin…