4 papers · 1 filter
A Scene Language Model for Open-Vocabulary Scene Mapping
Adam Lilja, Fabio Hübel, Siming He +6
Open-vocabulary 3D scene mapping aims to build a persistent representation of the objects in an environment. Existing systems typically rely on engineered mapping pipelines to asso…
Forecasting Motion in the Wild
Neerja Thakkar, Shiry Ginosar, Jacob Walker +3
Visual intelligence requires anticipating the future behavior of agents, yet vision systems lack a general representation for motion and behavior. We propose dense point trajectori…
Whole-Body Conditioned Egocentric Video Prediction
Yutong Bai, Danny Tran, Amir Bar +3
We train models to Predict Ego-centric Video from human Actions (PEVA), given the past video and an action represented by the relative 3D body pose. By conditioning on kinematic po…
TARDIS STRIDE: A Spatio-Temporal Road Image Dataset and World Model for Autonomy
Héctor Carrión, Yutong Bai, Víctor A. Hernández Castro +6
World models aim to simulate environments and enable effective agent behavior. However, modeling real-world environments presents unique challenges as they dynamically change acros…