Value Iteration with Guessing for Markov Chains and Markov Decision Processes

Krishnendu Chatterjee, Mahdi JafariRaviz, Raimundo Saona +1

Two standard models for probabilistic systems are Markov chains (MCs) and Markov decision processes (MDPs). Classic objectives for such probabilistic models for control and plannin…