MDP modeling for multi-stage stochastic programs

David P. Morton, Oscar Dowson, Bernardo K. Pagnoncelli

We study a class of multi-stage stochastic programs, which incorporate modeling features from Markov decision processes (MDPs). This class includes structured MDPs with continuous…