52 citations · 146 across the 41 of their papers we have counts for
3 papers · 1 filter
On the Sequential Probability Ratio Test in Hidden Markov Models
Oscar Darwin, Stefan Kiefer
We consider the Sequential Probability Ratio Test applied to Hidden Markov Models. Given two Hidden Markov Models and a sequence of observations generated by one of them, the Seque…
Transience in Countable MDPs
Stefan Kiefer, Richard Mayr, Mahsa Shirmohammadi +1
The Transience objective is not to visit any state infinitely often. While this is not possible in finite Markov Decision Process (MDP), it can be satisfied in countably infinite o…
Büchi Objectives in Countable MDPs
Stefan Kiefer, Richard Mayr, Mahsa Shirmohammadi +1
We study countably infinite Markov decision processes with Büchi objectives, which ask to visit a given subset of states infinitely often. A question left open by T.P. Hill in 1979…