Decisiveness for countable MDPs and insights for NPLCSs and POMDPs

Nathalie Bertrand, Patricia Bouyer, Thomas Brihaye +2

Markov chains and Markov decision processes (MDPs) are well-established probabilistic models. While finite Markov models are well-understood, analysing their infinite counterparts…