148 citations · 972 across the 92 of their papers we have counts for
13 papers · 1 filter
A Review of Off-Policy Evaluation in Reinforcement Learning
Masatoshi Uehara, Chengchun Shi, Nathan Kallus
Reinforcement learning (RL) is one of the most vibrant research frontiers in machine learning and has been recently applied to solve a number of challenging problems. In this paper…
The Implicit Delta Method
Nathan Kallus, James McInerney
Epistemic uncertainty quantification is a crucial part of drawing credible conclusions from predictive models, whether concerned about the prediction at a given point or any downst…
Provable Safe Reinforcement Learning with Binary Feedback
Andrew Bennett, Dipendra Misra, Nathan Kallus
Safety is a crucial necessity in many applications of reinforcement learning (RL), whether robotic, automotive, or medical. Many existing approaches to safe RL rely on receiving nu…
Inference on Strongly Identified Functionals of Weakly Identified Functions
Andrew Bennett, Nathan Kallus, Xiaojie Mao +3
In a variety of applications, including nonparametric instrumental variable (NPIV) analysis, proximal causal inference under unmeasured confounding, and missing-not-at-random data…
Learning Bellman Complete Representations for Offline Policy Evaluation
Jonathan D. Chang, Kaiwen Wang, Nathan Kallus +1
We study representation learning for Offline Reinforcement Learning (RL), focusing on the important task of Offline Policy Evaluation (OPE). Recent work shows that, in contrast to…
Future-Dependent Value-Based Off-Policy Evaluation in POMDPs
Masatoshi Uehara, Haruka Kiyohara, Andrew Bennett +5
We study off-policy evaluation (OPE) for partially observable MDPs (POMDPs) with general function approximation. Existing methods such as sequential importance sampling estimators…