The Markov-Chain Polytope with Applications

Mordecai J. Golin, Albert John Lalim Patupat

This paper addresses the problem of finding a minimum-cost $m$-state Markov chain $(S_0,\dots ,S_{m-1})$ in a large set of chains. The chains studied have a reward associated with…