8 papers
Scaling Self-Play for End-to-End Driving
Luke Rowe, Roger Girgis, Rodrigue de Schaetzen +6
End-to-end autonomous driving models are typically trained on offline human-demonstration datasets that provide limited state coverage and often no closed-loop feedback, making the…
FlowMaps: Modeling Long-Term Multimodal Object Dynamics with Flow Matching
Francesco Argenziano, Miguel Saavedra-Ruiz, Sacha Morin +3
Joint spatial and temporal understanding of 3D scenes is a crucial requirement for robots deployed in everyday household environments. Such agents must not only comprehend and navi…
3D Scene Graphs: Open Challenges and Future Directions
Dennis Rotondi, Francesco Argenziano, Sebastian Koch +10
3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Thei…
PerceptTwin: Semantic Scene Reconstruction for Iterative LLM Planning and Verification
Charlie Gauthier, Sacha Morin, Liam Paull
Simulation environments are useful for both robot policy learning and planning verification and validation. Traditionally, the process of creating a simulation was onerous. Creatin…
Agentic Scene Policies
Sacha Morin, Kumaraditya Gupta, Mahtab Sandhu +4
Designing or learning robot policies that generalize zero-shot across a range of language instructions and objects is a core problem in robotics. Vision-Language-Action models (VLA…
Dynamic Objects Relocalization in Changing Environments with Flow Matching
Francesco Argenziano, Miguel Saavedra-Ruiz, Sacha Morin +2
Task and motion planning are long-standing challenges in robotics, especially when robots have to deal with dynamic environments exhibiting long-term dynamics, such as households o…
OpenLex3D: A Tiered Evaluation Benchmark for Open-Vocabulary 3D Scene Representations
Christina Kassab, Sacha Morin, Martin Büchner +5
3D scene understanding has been transformed by open-vocabulary language models that enable interaction via natural language. However, at present the evaluation of these representat…
The Bare Necessities: Designing Simple, Effective Open-Vocabulary Scene Graphs
Christina Kassab, Matías Mattamala, Sacha Morin +4
3D open-vocabulary scene graph methods are a promising map representation for embodied agents, however many current approaches are computationally expensive. In this paper, we reex…