A Counterexample and a Corrective to the Vector Extension of the Bellman Equations of a Markov Decision Process

Anas Mifrani

Under the expected total reward criterion, the optimal value of a finite-horizon Markov decision process can be determined by solving the Bellman equations. The equations were exte…