Sequential Tracking of a Hidden Markov Chain Using Point Process Observations

Erhan Bayraktar, Mike Ludkovski

We study finite horizon optimal switching problems for hidden Markov chain models under partially observable Poisson processes. The controller possesses a finite range of strategie…