1.1k citations · 3k across the 23 of their papers we have counts for
7 papers · 1 filter
Stable Opponent Shaping in Differentiable Games
Alistair Letcher, Jakob Foerster, David Balduzzi +2
A growing number of learning methods are actually differentiable games whose players optimise multiple, interdependent objectives in parallel -- from GANs and intrinsic curiosity t…
Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning
Jakob N. Foerster, Francis Song, Edward Hughes +5
When observing the actions of others, humans make inferences about why they acted as they did, and what this implies about the world; humans also use the fact that their actions wi…
Multi-Agent Common Knowledge Reinforcement Learning
Christian A. Schroeder de Witt, Jakob N. Foerster, Gregory Farquhar +3
Cooperative multi-agent reinforcement learning often requires decentralised policies, which severely limit the agents' ability to coordinate their behaviour. In this paper, we show…
Pommerman: A Multi-Agent Playground
Cinjon Resnick, Wes Eldridge, David Ha +5
We present Pommerman, a multi-agent environment based on the classic console game Bomberman. Pommerman consists of a set of scenarios, each having at least four players and contain…
QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning
Tabish Rashid, Mikayel Samvelyan, Christian Schroeder de Witt +3
In many real-world settings, a team of agents must coordinate their behaviour while acting in a decentralised way. At the same time, it is often possible to train the agents in a c…
The Mechanics of n-Player Differentiable Games
David Balduzzi, Sebastien Racaniere, James Martens +3
The cornerstone underpinning deep learning is the guarantee that gradient descent on an objective converges to local minima. Unfortunately, this guarantee fails in settings, such a…
DiCE: The Infinitely Differentiable Monte-Carlo Estimator
Jakob Foerster, Gregory Farquhar, Maruan Al-Shedivat +3
The score function estimator is widely used for estimating gradients of stochastic objectives in stochastic computation graphs (SCG), eg, in reinforcement learning and meta-learnin…