38 citations · 63 across the 19 of their papers we have counts for
4 papers · 1 filter
Generalized Emphatic Temporal Difference Learning: Bias-Variance Analysis
Assaf Hallak, Aviv Tamar, Remi Munos +1
We consider the off-policy evaluation problem in Markov decision processes with function approximation. We propose a generalization of the recently introduced \emph{emphatic tempor…
Emphatic TD Bellman Operator is a Contraction
Assaf Hallak, Aviv Tamar, Shie Mannor
Recently, \citet{SuttonMW15} introduced the emphatic temporal differences (ETD) algorithm for off-policy evaluation in Markov decision processes. In this short note, we show that t…
Off-policy evaluation for MDPs with unknown structure
Assaf Hallak, François Schnitzler, Timothy Mann +1
Off-policy learning in dynamic decision problems is essential for providing strong evidence that a new policy is better than the one in use. But how can we prove superiority withou…
Contextual Markov Decision Processes
Assaf Hallak, Dotan Di Castro, Shie Mannor
We consider a planning problem where the dynamics and rewards of the environment depend on a hidden static parameter referred to as the context. The objective is to learn a strateg…