Cascade Markov Decision Processes: Theory and Applications

Manish Gupta

This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution o…