6 citations · 6 across the 2 of their papers we have counts for
6 papers
Work in Progress: Temporally Extended Auxiliary Tasks
Craig Sherstan, Bilal Kartal, Pablo Hernandez-Leal +1
Predictive auxiliary tasks have been shown to improve performance in numerous reinforcement learning works, however, this effect is still not well understood. The primary purpose o…
Gamma-Nets: Generalizing Value Estimation over Timescale
Craig Sherstan, Shibhansh Dohare, James MacGlashan +2
We present -nets, a method for generalizing value function estimation over timescale. By using the timescale as one of the estimator's inputs we can estimate value for arbitrary…
Accelerating Learning in Constructive Predictive Frameworks with the Successor Representation
Craig Sherstan, Marlos C. Machado, Patrick M. Pilarski
Here we propose using the successor representation (SR) to accelerate learning in a constructive knowledge system based on general value functions (GVFs). In real-world settings li…
Directly Estimating the Variance of the λ-Return Using Temporal-Difference Methods
Craig Sherstan, Brendan Bennett, Kenny Young +4
This paper investigates estimating the variance of a temporal-difference learning agent's update target. Most reinforcement learning methods use an estimate of the value function,…
Communicative Capital for Prosthetic Agents
Patrick M. Pilarski, Richard S. Sutton, Kory W. Mathewson +3
This work presents an overarching perspective on the role that machine intelligence can play in enhancing human abilities, especially those that have been diminished due to injury…
Introspective Agents: Confidence Measures for General Value Functions
Craig Sherstan, Adam White, Marlos C. Machado +1
Agents of general intelligence deployed in real-world scenarios must adapt to ever-changing environmental conditions. While such adaptive agents may leverage engineered knowledge,…