Markov Rewards Processes with Impulse Rewards and Absorbing States

Louis Tan, Kaveh Mahdaviani, Ashish Khisti

We study the expected accumulated reward for a discrete-time Markov reward model with absorbing states. The rewards are impulse rewards, where a reward ${\rho }_{ij}$ is accumulated when…