Optimal control of continuous-time Markov chains with noise-free observation

Alessandro Calvia

We consider an infinite horizon optimal control problem for a continuous-time Markov chain $X$ in a finite set $I$ with noise-free partial observation. The observation process is d…