activity
20232025
most citedMoving Off-the-Grid: Scene-Grounded Video Representations

1 citations · 4 across the 8 of their papers we have counts for

collaborators

8 papers

cs.RO2025★ 1 cited

Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer

Gemini Robotics Team, Abbas Abdolmaleki, Saminda Abeyruwan +169

General-purpose robots need a deep understanding of the physical world, advanced reasoning, and general and dexterous control. This report introduces the latest generation of the G…

cs.CV2025

Neural USD: An object-centric framework for iterative editing and control

Alejandro Escontrela, Shrinu Kushagra, Sjoerd van Steenkiste +5

Amazing progress has been made in controllable generative modeling, especially over the last few years. However, some challenges remain. One of them is precise and iterative object…

cs.CV2025

Direct Motion Models for Assessing Generated Videos

Kelsey Allen, Carl Doersch, Guangyao Zhou +9

A current limitation of video generative video models is that they generate plausible looking frames, but poor motion -- an issue that is not well captured by FVD and other popular…

cs.CV2024★ 1 cited

Moving Off-the-Grid: Scene-Grounded Video Representations

Sjoerd van Steenkiste, Daniel Zoran, Yi Yang +13

Current vision models typically maintain a fixed correspondence between their representation structure and image space. Each layer comprises a set of tokens arranged "on-the-grid,"…

cs.CV2024

Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models

Ziyi Wu, Yulia Rubanova, Rishabh Kabra +6

We address the problem of multi-object 3D pose control in image diffusion models. Instead of conditioning on a sequence of text tokens, we propose to use a set of per-object repres…

cs.LG2024★ 1 cited

Learning rigid-body simulators over implicit shapes for large-scale scenes and vision

Yulia Rubanova, Tatiana Lopez-Guevara, Kelsey R. Allen +3

Simulating large scenes with many rigid objects is crucial for a variety of applications, such as robotics, engineering, film and video games. Rigid interactions are notoriously ha…

cs.LG2024

Scaling Face Interaction Graph Networks to Real World Scenes

Tatiana Lopez-Guevara, Yulia Rubanova, William F. Whitney +3

Accurately simulating real world object dynamics is essential for various applications such as robotics, engineering, graphics, and design. To better capture complex real dynamics…

cs.LG2023★ 1 cited

Learning 3D Particle-based Simulators from RGB-D Videos

William F. Whitney, Tatiana Lopez-Guevara, Tobias Pfaff +4

Realistic simulation is critical for applications ranging from robotics to animation. Traditional analytic simulators sometimes struggle to capture sufficiently realistic simulatio…