Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methods
arXiv:2408.04268 · doi:10.1109/DOCS63458.2024.10704527
Abstract
Exploring the capabilities of Neural Radiance Fields (NeRF) and Gaussian-based methods in the context of 3D scene reconstruction, this study contrasts these modern approaches with traditional Simultaneous Localization and Mapping (SLAM) systems. Utilizing datasets such as Replica and ScanNet, we assess performance based on tracking accuracy, mapping fidelity, and view synthesis. Findings reveal that NeRF excels in view synthesis, offering unique capabilities in generating new perspectives from existing data, albeit at slower processing speeds. Conversely, Gaussian-based methods provide rapid processing and significant expressiveness but lack comprehensive scene completion. Enhanced by global optimization and loop closure techniques, newer methods like NICE-SLAM and SplaTAM not only surpass older frameworks such as ORB-SLAM2 in terms of robustness but also demonstrate superior performance in dynamic and complex environments. This comparative analysis bridges theoretical research with practical implications, shedding light on future developments in robust 3D scene reconstruction across various real-world applications.
Accepted by 2024 6th International Conference on Data-driven Optimization of Complex Systems
References in corpus (17)
- The Replica Dataset: A Digital Replica of Indoor Spaces
- Exploring Diverse Methods in Visual Question Answering
- Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformers
- Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networks
- Regional Style and Color Transfer
- Towards Open World NeRF-Based SLAM
- DeepGI: An Automated Approach for Gastrointestinal Tract Segmentation in MRI Scans
- Transfer learning-based physics-informed convolutional neural network for simulating flow in porous media with time-varying controls
- Credit Card Fraud Detection Using Advanced Transformer Model
- Physics-informed Convolutional Recurrent Surrogate Model for Reservoir Simulation with Well Controls
- GM-DF: Generalized Multi-Scenario Deepfake Detection
- Mapping New Realities: Ground Truth Image Creation with Pix2Pix Image-to-Image Translation
- Towards Rationality in Language and Multimodal Agents: A Survey
- X-SLAM: Scalable Dense SLAM for Task-aware Optimization using CSFD
- RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting
- A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners
- Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge