54 citations · 102 across the 3 of their papers we have counts for
3 papers
cs.AI2012★ 54 cited
Metrics for Finite Markov Decision Processes
Norman Ferns, Prakash Panangaden, Doina Precup
We present metrics for measuring the similarity of states in a finite Markov decision process (MDP). The formulation of our metrics is based on the notion of bisimulation for MDPs,…
cs.AI2012★ 46 cited
Metrics for Markov Decision Processes with Infinite State Spaces
Norman Ferns, Prakash Panangaden, Doina Precup
We present metrics for measuring state similarity in Markov decision processes (MDPs) with infinitely many states, including MDPs with continuous state spaces. Such metrics provide…
cs.LG2012★ 2 cited
Improved Estimation in Time Varying Models
Doina Precup, Philip Bachman
Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the vari…