2 citations · 2 across the 9 of their papers we have counts for
9 papers
Benchmarking World Models for Continual Learning on Compositional Tasks
Haoyu Zhou, Joe Watson, Anson Lei +1
A desirable property of a world model is the ability to learn continually across tasks, adapting to new environments without forgetting what the agent has already learnt. In partic…
From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery
Ingmar Posner, Anson Lei, Bernhard Schölkopf
Recent advances in foundation models have transformed AI for Science, enabling remarkably accurate predictive performance across domains ranging from protein folding to weather for…
Imitation from Heterogeneous Demonstrations using Grounded Latent-Action World Models
Tianyou Wang, Anson Lei, Joe Watson +1
Imitation learning has emerged as a powerful paradigm for learning visuomotor policies, but its generalisation and stability are limited by the scale and quality of demonstration d…
No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation
Bradley Stanley-Clamp, Anson Lei, Hannah M. Christensen +1
Climate emulation is an out-of-distribution (OOD) projection task. This is precisely the challenge where modern Machine Learning (ML) methods are most prone to failure. Consequentl…
Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention
Markus W. Baumgartner, Anson Lei, Joe Watson +1
Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit f…
Intrinsically Interpretable Attention via Sparse Post-Training
Florent Draye, Anson Lei, Hsiao-Ru Pan +2
We introduce a simple post-training method that makes transformer attention sparse without sacrificing performance. Applying a flexible sparsity regularisation under a constrained-…
SPARTAN: A Sparse Transformer World Model Attending to What Matters
Anson Lei, Bernhard Schölkopf, Ingmar Posner
Capturing the interactions between entities in a structured way plays a central role in world models that flexibly adapt to changes in the environment. Recent works motivate the be…
Compete and Compose: Learning Independent Mechanisms for Modular World Models
Anson Lei, Frederik Nolte, Bernhard Schölkopf +1
We present COmpetitive Mechanisms for Efficient Transfer (COMET), a modular world model which leverages reusable, independent mechanisms across different environments. COMET is tra…
Variational Causal Dynamics: Discovering Modular World Models from Interventions
Anson Lei, Bernhard Schölkopf, Ingmar Posner
Latent world models allow agents to reason about complex environments with high-dimensional observations. However, adapting to new environments and effectively leveraging previous…