Exact finite approximations of average-cost countable Markov Decision Processes

Arie Leizarowitz, Adam Shwartz

For a countable-state Markov decision process we introduce an embedding which produces a finite-state Markov decision process. The finite-state embedded process has the same optima…