4 papers
BulletGen: Improving 4D Reconstruction with Bullet-Time Generation
Denis Rozumny, Jonathon Luiten, Numair Khan +2
Transforming casually captured, monocular videos into fully immersive dynamic experiences is a highly ill-posed task, and comes with significant challenges, e.g., reconstructing un…
Explaining Human Preferences via Metrics for Structured 3D Reconstruction
Jack Langerman, Denys Rozumnyi, Yuzhong Huang +1
"What cannot be measured cannot be improved" while likely never uttered by Lord Kelvin, summarizes effectively the driving force behind this work. This paper presents a detailed di…
A Recipe for Generating 3D Worlds From a Single Image
Katja Schwarz, Denys Rozumnyi, Samuel Rota Bulò +2
We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires…
XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration
Denys Rozumnyi, Nadine Bertsch, Othman Sbai +6
Tracking the full body motions of users in XR (AR/VR) devices is a fundamental challenge to bring a sense of authentic social presence. Due to the absence of dedicated leg sensors,…