Latent Action World Models for Control with Unlabeled Trajectories

Marvin Alles, Xingyuan Zhang, Patrick van der Smagt +1

Inspired by how humans combine direct interaction with action-free experience (e.g., videos), we study world models that learn from heterogeneous data. Standard world models typica…