9 papers
SceneFrom3D: Geometry-Conditioned Outdoor 3D Scene Generation via View Scheduling with Object-Level Control
Geonung Kim, Jeongeun Park, Nuri Ryu +2
Geometry-conditioned 3D scene generation enables the creation of 3D environments from user-provided geometry, offering direct control over scene structure and object layout. To gen…
SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues
Suttisak Wizadwongsa, Hyelin Nam, Supasorn Suwajanakorn +1
Generating novel renderings of a scene along user-defined camera trajectories from a single monocular video, dubbed video retaking, is a compelling but difficult problem in content…
Prospective Dynamic 3D MRI Reconstruction via Latent-Space Motion Tracking from Single Measurement
Lixuan Chen, Zhongnan Liu, Jesse Hamilton +3
Prospective reconstruction is crucial in many clinical applications such as MRI-guided radiotherapy, which demands accurate image reconstruction and fast motion estimation from cur…
HL-OutPaint: Coarse-to-Fine Video Outpainting for High-Resolution Long-Range Videos
Jeongeun Park, Janghyeok Han, Geonung Kim +4
Video outpainting generates plausible visual content beyond the original spatial extent of a video, playing a key role in adapting videos to diverse display formats. To support suc…
MoE3D: A Mixture-of-Experts Module for 3D Reconstruction
Zichen Wang, Ang Cao, Liam J. Wang +1
We propose a simple yet effective approach to enhance the performance of feed-forward 3D reconstruction models. Existing methods often struggle near depth discontinuities, where st…
Generative Spatiotemporal Data Augmentation
Jinfan Zhou, Lixin Luo, Sungmin Eum +2
We explore spatiotemporal data augmentation using video foundation models to diversify both camera viewpoints and scene dynamics. Unlike existing approaches based on simple geometr…
VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Models
Edward Li, Zichen Wang, Jiahe Huang +1
We present a unified framework for solving partial differential equations (PDEs) using video-inpainting diffusion transformer models. Unlike existing methods that devise specialize…
Taming Feed-forward Reconstruction Models as Latent Encoders for 3D Generative Models
Suttisak Wizadwongsa, Jinfan Zhou, Edward Li +1
Recent AI-based 3D content creation has largely evolved along two paths: feed-forward image-to-3D reconstruction approaches and 3D generative models trained with 2D or 3D supervisi…
DiffusionPDE: Generative PDE-Solving Under Partial Observation
Jiahe Huang, Guandao Yang, Zichen Wang +1
We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have…