5 papers
SemVideo: Reconstructs What You Watch from Brain Activity via Hierarchical Semantic Guidance
Minghan Yang, Lan Yang, Ke Li +3
Reconstructing dynamic visual experiences from brain activity provides a compelling avenue for exploring the neural mechanisms of human visual perception. While recent progress in…
Human Video Generation from a Single Image with 3D Pose and View Control
Tiantian Wang, Chun-Han Yao, Tao Hu +3
Recent diffusion methods have made significant progress in generating videos from single images due to their powerful visual generation capabilities. However, challenges persist in…
Restage4D: Reanimating Deformable 3D Reconstruction from a Single Video
Jixuan He, Chieh Hubert Lin, Lu Qi +1
Creating deformable 3D content has gained increasing attention with the rise of text-to-image and image-to-video generative models. While these models provide rich semantic priors…
InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Junqi You, Chieh Hubert Lin, Weijie Lyu +2
Recent advances in 3D scene reconstruction enable real-time viewing in virtual and augmented reality. To support interactive operations for better immersiveness, such as moving or…
DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos
Chieh Hubert Lin, Zhaoyang Lv, Songyin Wu +11
We introduce the Deformable Gaussian Splats Large Reconstruction Model (DGS-LRM), the first feed-forward method predicting deformable 3D Gaussian splats from a monocular posed vide…