21 citations · 135 across the 39 of their papers we have counts for
27 papers · 1 filter
Open-Endedness is Essential for Artificial Superhuman Intelligence
Edward Hughes, Michael Dennis, Jack Parker-Holder +5
In recent years there has been a tremendous surge in the general capabilities of AI systems, mainly fuelled by training foundation models on internetscale data. Nevertheless, the c…
Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMs
Davide Paglieri, Saurabh Dash, Tim Rocktäschel +1
Post-Training Quantization (PTQ) enhances the efficiency of Large Language Models (LLMs) by enabling faster operation and compatibility with more accessible hardware through reduce…
Genie: Generative Interactive Environments
Jake Bruce, Michael Dennis, Ashley Edwards +22
We introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless…
Multi-Agent Diagnostics for Robustness via Illuminated Diversity
Mikayel Samvelyan, Davide Paglieri, Minqi Jiang +2
In the rapidly advancing field of multi-agent systems, ensuring robustness in unfamiliar and adversarial settings is crucial. Notwithstanding their outstanding performance in famil…
Leading the Pack: N-player Opponent Shaping
Alexandra Souly, Timon Willi, Akbir Khan +4
Reinforcement learning solutions have great success in the 2-player general sum setting. In this setting, the paradigm of Opponent Shaping (OS), in which agents account for the lea…
H-GAP: Humanoid Control with a Generalist Planner
Zhengyao Jiang, Yingchen Xu, Nolan Wagener +5
Humanoid control is an important research challenge offering avenues for integration into human-centric infrastructures and enabling physics-driven humanoid animations. The dauntin…
Vision-Language Models as a Source of Rewards
Kate Baumli, Satinder Baveja, Feryal Behbahani +24
Building generalist agents that can accomplish many goals in rich open-ended environments is one of the research frontiers for reinforcement learning. A key limiting factor for bui…
Mix-ME: Quality-Diversity for Multi-Agent Learning
Garðar Ingvarsson, Mikayel Samvelyan, Bryan Lim +3
In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient. Instead, a diverse set of high-performing solutions is often requ…
Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks
Samyak Jain, Robert Kirk, Ekdeep Singh Lubana +5
Fine-tuning large pre-trained models has become the de facto strategy for developing both task-specific and general-purpose machine learning systems, including developing models th…
minimax: Efficient Baselines for Autocurricula in JAX
Minqi Jiang, Michael Dennis, Edward Grefenstette +1
Unsupervised environment design (UED) is a form of automatic curriculum learning for training robust decision-making agents to zero-shot transfer into unseen environments. Such aut…
JaxMARL: Multi-Agent RL Environments and Algorithms in JAX
Alexander Rutherford, Benjamin Ellis, Matteo Gallici +18
Benchmarks are crucial in the development of machine learning algorithms, with available environments significantly influencing reinforcement learning (RL) research. Traditionally,…
Stabilizing Unsupervised Environment Design with a Learned Adversary
Ishita Mediratta, Minqi Jiang, Jack Parker-Holder +3
A key challenge in training generally-capable agents is the design of training tasks that facilitate broad generalization and robustness to environment variations. This challenge m…
MAESTRO: Open-Ended Environment Design for Multi-Agent Reinforcement Learning
Mikayel Samvelyan, Akbir Khan, Michael Dennis +5
Open-ended learning methods that automatically generate a curriculum of increasingly challenging tasks serve as a promising avenue toward generally capable reinforcement learning a…
Learning General World Models in a Handful of Reward-Free Deployments
Yingchen Xu, Jack Parker-Holder, Aldo Pacchiano +5
Building generally capable agents is a grand challenge for deep reinforcement learning (RL). To approach this challenge practically, we outline two key desiderata: 1) to facilitate…
Improving Policy Learning via Language Dynamics Distillation
Victor Zhong, Jesse Mu, Luke Zettlemoyer +2
Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how t…
Hierarchical Kickstarting for Skill Transfer in Reinforcement Learning
Michael Matthews, Mikayel Samvelyan, Jack Parker-Holder +2
Practising and honing skills forms a fundamental component of how humans learn, yet artificial agents are rarely specifically trained to perform them. Instead, they are usually tra…
Efficient Planning in a Compact Latent Action Space
Zhengyao Jiang, Tianjun Zhang, Michael Janner +4
Planning-based reinforcement learning has shown strong performance in tasks in discrete and low-dimensional continuous action spaces. However, planning usually brings significant c…
Grounding Aleatoric Uncertainty for Unsupervised Environment Design
Minqi Jiang, Michael Dennis, Jack Parker-Holder +5
Adaptive curricula in reinforcement learning (RL) have proven effective for producing policies robust to discrepancies between the train and test environment. Recently, the Unsuper…
Graph Backup: Data Efficient Backup Exploiting Markovian Transitions
Zhengyao Jiang, Tianjun Zhang, Robert Kirk +2
The successes of deep Reinforcement Learning (RL) are limited to settings where we have a large stream of online experiences, but applying RL in the data-efficient setting with lim…
Insights From the NeurIPS 2021 NetHack Challenge
Eric Hambro, Sharada Mohanty, Dmitrii Babaev +26
In this report, we summarize the takeaways from the first NeurIPS 2021 NetHack Challenge. Participants were tasked with developing a program or agent that can win (i.e., 'ascend' i…
Evolving Curricula with Regret-Based Environment Design
Jack Parker-Holder, Minqi Jiang, Michael Dennis +4
It remains a significant challenge to train generally capable agents with reinforcement learning (RL). A promising avenue for improving the robustness of RL agents is through the u…
Generalization in Cooperative Multi-Agent Systems
Anuj Mahajan, Mikayel Samvelyan, Tarun Gupta +4
Collective intelligence is a fundamental trait shared by several species of living organisms. It has allowed them to thrive in the diverse environmental conditions that exist on ou…
Improving Intrinsic Exploration with Language Abstractions
Jesse Mu, Victor Zhong, Roberta Raileanu +4
Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their envi…
Replay-Guided Adversarial Environment Design
Minqi Jiang, Michael Dennis, Jack Parker-Holder +3
Deep reinforcement learning (RL) agents may successfully generalize to new settings if trained on an appropriately diverse set of environment and task configurations. Unsupervised…