429 citations · 442 across the 9 of their papers we have counts for
13 papers
SneakPeek: Future-Guided Instructional Streaming Video Generation
Cheeun Hong, German Barquero, Fadime Sener +6
Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad imp…
CamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control
Stefan Popov, Amit Raj, Michael Krainin +3
We propose a method for generating fly-through videos of a scene, from a single image and a given camera trajectory. We build upon an image-to-video latent diffusion model. We cond…
NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations
Varun Jampani, Kevis-Kokitsi Maninis, Andreas Engelhardt +13
Recent advances in neural reconstruction enable high-quality 3D object reconstruction from casually captured image collections. Current techniques mostly analyze their progress on…
Estimating Generic 3D Room Structures from 2D Annotations
Denys Rozumnyi, Stefan Popov, Kevis-Kokitsi Maninis +2
Indoor rooms are among the most common use cases in 3D scene understanding. Current state-of-the-art methods for this task are driven by large annotated datasets. Room layouts are…
CAD-Estate: Large-scale CAD Model Annotation in RGB Videos
Kevis-Kokitsi Maninis, Stefan Popov, Matthias Nießner +1
We propose a method for annotating videos of complex multi-object scenes with a globally-consistent 3D representation of the objects. We annotate each object with a CAD model from…
RayTran: 3D pose estimation and shape reconstruction of multiple objects from videos with ray-traced transformers
Michał J. Tyszkiewicz, Kevis-Kokitsi Maninis, Stefan Popov +1
We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a gl…