1k citations · 2k across the 65 of their papers we have counts for
5 papers · 1 filter
Generalized Emphatic Temporal Difference Learning: Bias-Variance Analysis
Assaf Hallak, Aviv Tamar, Remi Munos +1
We consider the off-policy evaluation problem in Markov decision processes with function approximation. We propose a generalization of the recently introduced \emph{emphatic tempor…
Emphatic TD Bellman Operator is a Contraction
Assaf Hallak, Aviv Tamar, Shie Mannor
Recently, \citet{SuttonMW15} introduced the emphatic temporal differences (ETD) algorithm for off-policy evaluation in Markov decision processes. In this short note, we show that t…
Implicit Temporal Differences
Aviv Tamar, Panos Toulis, Shie Mannor +1
In reinforcement learning, the TD() algorithm is a fundamental policy evaluation method with an efficient online implementation that is suitable for large-scale problems. One pr…
Optimizing the CVaR via Sampling
Aviv Tamar, Yonatan Glassner, Shie Mannor
Conditional Value at Risk (CVaR) is a prominent risk measure that is being used extensively in various domains. We develop a new formula for the gradient of the CVaR in the form of…
Variance Adjusted Actor Critic Algorithms
Aviv Tamar, Shie Mannor
We present an actor-critic framework for MDPs where the objective is the variance-adjusted expected return. Our critic uses linear function approximation, and we extend the concept…