54 citations · 100 across the 2 of their papers we have counts for
2 papers
cs.AI2012★ 54 cited
Metrics for Finite Markov Decision Processes
Norman Ferns, Prakash Panangaden, Doina Precup
We present metrics for measuring the similarity of states in a finite Markov decision process (MDP). The formulation of our metrics is based on the notion of bisimulation for MDPs,…
cs.AI2012★ 46 cited
Metrics for Markov Decision Processes with Infinite State Spaces
Norman Ferns, Prakash Panangaden, Doina Precup
We present metrics for measuring state similarity in Markov decision processes (MDPs) with infinitely many states, including MDPs with continuous state spaces. Such metrics provide…