8 papers
Efficient Reinforcement Learning by Guiding World Models with Non-Curated Data
Yi Zhao, Aidan Scannell, Wenshuai Zhao +7
Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online…
Kalman Linear Attention: Parallel Bayesian Filtering For Efficient Language Modelling and State Tracking
Vaisakh Shaj, Cameron Barker, Aidan Scannell +3
State-space language models such as Mamba and gated linear attention (GLA) offer linear-complexity, parallelisable alternatives to transformers, but their linear state updates limi…
Benchmarking Open-Ended Multi-Agent Coordination in Language Agents
Kale-ab Abebe Tessera, Andras Szecsenyi, Cameron Barker +7
As language models are increasingly deployed as autonomous agents, they must coordinate with others over long horizons in open-ended interactive tasks. Yet existing evaluations rar…
Contextual Latent World Models for Offline Meta Reinforcement Learning
Mohammadreza Nakheai, Aidan Scannell, Kevin Luck +1
Offline meta-reinforcement learning seeks to learn policies that generalize across related tasks from fixed datasets. Context-based methods infer a task representation from transit…
Forgetting is Everywhere
Ben Sanati, Thomas L. Lee, Trevor McInroe +5
A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge as they adapt to new data. Addressing this problem requires a principle…
Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report
Riccardo Mereu, Aidan Scannell, Yuxin Hou +6
World models are a powerful paradigm in AI and robotics, enabling agents to reason about the future by predicting visual observations or compact latent states. The 1X World Model C…