1.8k citations · 3.8k across the 35 of their papers we have counts for
17 papers · 1 filter
Autoregressive Dynamics Models for Offline Policy Evaluation and Optimization
Michael R. Zhang, Tom Le Paine, Ofir Nachum +4
Standard dynamics models for continuous control make use of feedforward computation to predict the conditional distribution of next state and reward given current state and action…
Benchmarks for Deep Off-Policy Evaluation
Justin Fu, Mohammad Norouzi, Ofir Nachum +10
Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability…
Regularized Behavior Value Estimation
Caglar Gulcehre, Sergio Gómez Colmenarejo, Ziyu Wang +7
Offline reinforcement learning restricts the learning process to rely only on logged-data without access to an environment. While this enables real-world applications, it also pose…
Offline Learning from Demonstrations and Unlabeled Experience
Konrad Zolna, Alexander Novikov, Ksenia Konyushkova +6
Behavior cloning (BC) is often practical for robot learning because it allows a policy to be trained offline without rewards, by supervised learning on expert demonstrations. Howev…
Hyperparameter Selection for Offline Reinforcement Learning
Tom Le Paine, Cosmin Paduraru, Andrea Michi +5
Offline reinforcement learning (RL purely from logged data) is an important avenue for deploying RL techniques in real-world scenarios. However, existing hyperparameter selection m…
Critic Regularized Regression
Ziyu Wang, Alexander Novikov, Konrad Zolna +8
Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It…
RL Unplugged: A Suite of Benchmarks for Offline Reinforcement Learning
Caglar Gulcehre, Ziyu Wang, Alexander Novikov +15
Offline methods for reinforcement learning have a potential to help bridge the gap between reinforcement learning research and real-world applications. They make it possible to lea…
Acme: A Research Framework for Distributed Reinforcement Learning
Matthew W. Hoffman, Bobak Shahriari, John Aslanides +36
Deep reinforcement learning (RL) has led to many recent and groundbreaking advances. However, these advances have often come at the cost of both increased scale in the underlying a…
Task-Relevant Adversarial Imitation Learning
Konrad Zolna, Scott Reed, Alexander Novikov +6
We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. W…
Making Efficient Use of Demonstrations to Solve Hard Exploration Problems
Tom Le Paine, Caglar Gulcehre, Bobak Shahriari +11
This paper introduces R2D3, an agent that makes efficient use of demonstrations to solve hard exploration problems in partially observable environments with highly variable initial…
Bayesian Optimization in AlphaGo
Yutian Chen, Aja Huang, Ziyu Wang +4
During the development of AlphaGo, its many hyper-parameters were tuned with Bayesian optimization multiple times. This automatic tuning process resulted in substantial improvement…
One-Shot High-Fidelity Imitation: Training Large-Scale Deep Nets with RL
Tom Le Paine, Sergio Gómez Colmenarejo, Ziyu Wang +8
Humans are experts at high-fidelity imitation -- closely mimicking a demonstration, often in one attempt. Humans use this ability to quickly solve a task instance, and to bootstrap…
Playing hard exploration games by watching YouTube
Yusuf Aytar, Tobias Pfaff, David Budden +3
Deep reinforcement learning methods traditionally struggle with tasks where environment rewards are particularly sparse. One successful method of guiding exploration in these domai…
Robust Imitation of Diverse Behaviors
Ziyu Wang, Josh Merel, Scott Reed +3
Deep generative models have recently shown great promise in imitation learning for motor control. Given enough data, even supervised approaches can do one-shot imitation learning;…
Sample Efficient Actor-Critic with Experience Replay
Ziyu Wang, Victor Bapst, Nicolas Heess +4
This paper presents an actor-critic deep reinforcement learning agent with experience replay that is stable, sample efficient, and performs remarkably well on challenging environme…
Dueling Network Architectures for Deep Reinforcement Learning
Ziyu Wang, Tom Schaul, Matteo Hessel +3
In recent years there have been many successes of using deep representations in reinforcement learning. Still, many of these applications use conventional architectures, such as co…
Heteroscedastic Treed Bayesian Optimisation
John-Alexander M. Assael, Ziyu Wang, Bobak Shahriari +1
Optimising black-box functions is important in many disciplines, such as tuning machine learning models, robotics, finance and mining exploration. Bayesian optimisation is a state-…