First-order sensitivity of the optimal value in a Markov decision model with respect to deviations in the transition probability function

Patrick Kern, Axel Simroth, Henryk Zähle

Markov decision models (MDM) used in practical applications are most often less complex than the underlying `true' MDM. The reduction of model complexity is performed for several r…