When to look at a noisy Markov chain in sequential decision making if measurements are costly?

Vikram Krishnamurthy

A decision maker records measurements of a finite-state Markov chain corrupted by noise. The goal is to decide when the Markov chain hits a specific target state. The decision make…