265 citations · 1.6k across the 43 of their papers we have counts for
9 papers · 1 filter
A case for new neural network smoothness constraints
Mihaela Rosca, Theophane Weber, Arthur Gretton +1
How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization,…
Counterfactual Credit Assignment in Model-Free Reinforcement Learning
Thomas Mesnard, Théophane Weber, Fabio Viola +11
Credit assignment in reinforcement learning is the problem of measuring an action's influence on future rewards. In particular, this requires separating skill from luck, i.e. disen…
On the role of planning in model-based deep reinforcement learning
Jessica B. Hamrick, Abram L. Friesen, Feryal Behbahani +7
Model-based planning is often thought to be necessary for deep, careful reasoning and generalization in artificial agents. While recent successes of model-based reinforcement learn…
Physically Embedded Planning Problems: New Challenges for Reinforcement Learning
Mehdi Mirza, Andrew Jaegle, Jonathan J. Hunt +9
Recent work in deep reinforcement learning (RL) has produced algorithms capable of mastering challenging games such as Go, chess, or shogi. In these works the RL agent directly obs…
Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D Sokoban
Peter Karkus, Mehdi Mirza, Arthur Guez +5
Intelligent robots need to achieve abstract objectives using concrete, spatiotemporally complex sensory information and motor control. Tabula rasa deep reinforcement learning (RL)…
Divide-and-Conquer Monte Carlo Tree Search For Goal-Directed Planning
Giambattista Parascandolo, Lars Buesing, Josh Merel +6
Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumpt…
Causally Correct Partial Models for Reinforcement Learning
Danilo J. Rezende, Ivo Danihelka, George Papamakarios +11
In reinforcement learning, we can learn a model of future observations and rewards, and use it to plan the agent's next actions. However, jointly modeling future observations can b…
Value-driven Hindsight Modelling
Arthur Guez, Fabio Viola, Théophane Weber +5
Value estimation is a critical component of the reinforcement learning (RL) paradigm. The question of how to effectively learn value predictors from data is one of the major proble…
Combining Q-Learning and Search with Amortized Value Estimates
Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez +4
We introduce "Search with Amortized Value Estimates" (SAVE), an approach for combining model-free Q-learning with model-based Monte-Carlo Tree Search (MCTS). In SAVE, a learned pri…