1k citations · 2k across the 65 of their papers we have counts for
4 papers · 1 filter
Generalized Emphatic Temporal Difference Learning: Bias-Variance Analysis
Assaf Hallak, Aviv Tamar, Remi Munos +1
We consider the off-policy evaluation problem in Markov decision processes with function approximation. We propose a generalization of the recently introduced \emph{emphatic tempor…
Emphatic TD Bellman Operator is a Contraction
Assaf Hallak, Aviv Tamar, Shie Mannor
Recently, \citet{SuttonMW15} introduced the emphatic temporal differences (ETD) algorithm for off-policy evaluation in Markov decision processes. In this short note, we show that t…
Risk-Sensitive and Robust Decision-Making: a CVaR Optimization Approach
Yinlam Chow, Aviv Tamar, Shie Mannor +1
In this paper we address the problem of decision making within a Markov decision process (MDP) framework where risk and modeling errors are taken into account. Our approach is to m…
Policy Gradient for Coherent Risk Measures
Aviv Tamar, Yinlam Chow, Mohammad Ghavamzadeh +1
Several authors have recently developed risk-sensitive policy gradient methods that augment the standard expected cost minimization problem with a measure of variability in cost. T…