Extreme occupation measures in Markov decision processes with a cemetery

Alexey Piunovskiy, Yi Zhang

In this paper, we consider a Markov decision process (MDP) with a Borel state space $\text{X}\cup \{\Delta \}$, where $\Delta$ is an absorbing state (cemetery), and a Borel action space $\te…