Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation
arXiv:2210.15858 · doi:10.1109/ISMAR55827.2022.00066
Abstract
In this work, we present a dense tracking and mapping system named Vox-Fusion, which seamlessly fuses neural implicit representations with traditional volumetric fusion methods. Our approach is inspired by the recently developed implicit mapping and positioning system and further extends the idea so that it can be freely applied to practical scenarios. Specifically, we leverage a voxel-based neural implicit surface representation to encode and optimize the scene inside each voxel. Furthermore, we adopt an octree-based structure to divide the scene and support dynamic expansion, enabling our system to track and map arbitrary scenes without knowing the environment like in previous works. Moreover, we proposed a high-performance multi-process framework to speed up the method, thus supporting some applications that require real-time performance. The evaluation results show that our methods can achieve better accuracy and completeness than previous methods. We also show that our Vox-Fusion can be used in augmented reality and virtual reality applications. Our source code is publicly available at https://github.com/zju3dv/Vox-Fusion.
References in corpus (8)
- ORB-SLAM: a Versatile and Accurate Monocular SLAM System
- ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras
- ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
- The Replica Dataset: A Digital Replica of Indoor Spaces
- DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Cameras
- DeepFactors: Real-Time Probabilistic Dense Monocular SLAM
- BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
- FD-SLAM: 3-D Reconstruction Using Features and Dense Matching
Cited by in corpus (14)
- SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM
- PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency
- RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
- H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representation
- NEDS-SLAM: A Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting
- RO-MAP: Real-Time Multi-Object Mapping with Neural Radiance Fields
- Towards Open World NeRF-Based SLAM
- GS3LAM: Gaussian Semantic Splatting SLAM
- RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes
- SplatMAP: Online Dense Monocular SLAM with 3D Gaussian Splatting
- TivNe-SLAM: Dynamic Mapping and Tracking via Time-Varying Neural Radiance Fields
- UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAM
- Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAM
- ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM