4 papers
Adapting Vision-Language Models for Evaluating World Models
Mariya Hendriksen, Tabish Rashid, David Bignell +5
World models - generative models that simulate environment dynamics conditioned on past observations and actions - are gaining prominence in planning, simulation, and embodied AI.…
Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games
Lukas Schäfer, Logan Jones, Anssi Kanervisto +7
Video games have served as useful benchmarks for the decision-making community, but going beyond Atari games towards modern games has been prohibitively expensive for the vast majo…
Adapting a World Model for Trajectory Following in a 3D Game
Marko Tot, Shu Ishida, Abdelhak Lemkhenter +10
Imitation learning is a powerful tool for training agents by leveraging expert knowledge, and being able to replicate a given trajectory is an integral part of it. In complex envir…
Scaling Laws for Pre-training Agents and World Models
Tim Pearce, Tabish Rashid, Dave Bignell +3
The performance of embodied agents has been shown to improve by increasing model parameters, dataset size, and compute. This has been demonstrated in domains from robotics to video…