LpWM: A Case for Sparse Representations in World Models

Yilun Kuang, Yash Dagade, Quentin Le Lidec +3

Joint-embedding predictive architectures (JEPAs) learn latent dynamics for planning and avoid representation collapse by matching features to maximum-entropy distributions such as…