Long run control of nonhomogeneous Markov processes

Abstract

In the paper average reward per unit time and average risk sensitive reward functionals are considered for controlled nonhomogeneous Markov processes. Existence of solutions to suitable Bellman equations is shown. Continuity of the value functions with respect to risk parameter is also proved. Finally stability of functionals with respect to pointwise convergence of Markov controls is studied.