Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review
arXiv:2405.03417 · doi:10.1109/ACCESS.2024.3408318
Abstract
Image-based 3D reconstruction is a challenging task that involves inferring the 3D shape of an object or scene from a set of input images. Learning-based methods have gained attention for their ability to directly estimate 3D shapes. This review paper focuses on state-of-the-art techniques for 3D reconstruction, including the generation of novel, unseen views. An overview of recent developments in the Gaussian Splatting method is provided, covering input types, model structures, output representations, and training strategies. Unresolved challenges and future directions are also discussed. Given the rapid progress in this domain and the numerous opportunities for enhancing 3D reconstruction methods, a comprehensive examination of algorithms appears essential. Consequently, this study offers a thorough overview of the latest advancements in Gaussian Splatting.
24 pages
References in corpus (24)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- The Replica Dataset: A Digital Replica of Indoor Spaces
- DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks
- Point-E: A System for Generating 3D Point Clouds from Complex Prompts
- NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)
- DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation
- LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
- SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
- Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting
- Drivable 3D Gaussian Avatars
- NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance
- LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
- TBench: Benchmarking Current Progress in Text-to-3D Generation
- BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields
- CompGS: Smaller and Faster Gaussian Splatting with Vector Quantization
- Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracing
- DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulation
- Segment Any 4D Gaussians
- SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos
- Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering
- A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesis
- GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise
- CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting
- Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting