DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes
arXiv:1806.05620 · doi:10.1109/LRA.2018.2860039
Abstract
The assumption of scene rigidity is typical in SLAM algorithms. Such a strong assumption limits the use of most visual SLAM systems in populated real-world environments, which are the target of several relevant applications like service robotics or autonomous vehicles. In this paper we present DynaSLAM, a visual SLAM system that, building over ORB-SLAM2 [1], adds the capabilities of dynamic object detection and background inpainting. DynaSLAM is robust in dynamic scenarios for monocular, stereo and RGB-D configurations. We are capable of detecting the moving objects either by multi-view geometry, deep learning or both. Having a static map of the scene allows inpainting the frame background that has been occluded by such dynamic objects. We evaluate our system in public monocular, stereo and RGB-D datasets. We study the impact of several accuracy/speed trade-offs to assess the limits of the proposed methodology. DynaSLAM outperforms the accuracy of standard visual SLAM baselines in highly dynamic scenarios. And it also estimates a map of the static parts of the scene, which is a must for long-term applications in real-world environments.
arXiv commentThis work has been accepted at IEEE Robotics and Automation Letters, and will be presented at the IEEE Conference on Intelligent Robots and Systems 2018
References in corpus (2)
Cited by in corpus (32)
- SuMa++: Efficient LiDAR-based Semantic SLAM
- CubeSLAM: Monocular 3D Object SLAM
- Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentation
- The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
- DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association
- Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
- RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments
- AirDOS: Dynamic SLAM benefits from Articulated Objects
- From SLAM to Situational Awareness: Challenges and Survey
- VIODE: A Simulated Dataset to Address the Challenges of Visual-Inertial Odometry in Dynamic Environments
- RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
- TwistSLAM: Constrained SLAM in Dynamic Environment
- DASGIL: Domain Adaptation for Semantic and Geometric-aware Image-based Localization
- Fast ORB-SLAM without Keypoint Descriptors
- Empty Cities: a Dynamic-Object-Invariant Space for Visual SLAM
- Domain-invariant Similarity Activation Map Contrastive Learning for Retrieval-based Long-term Visual Localization
- A Unified Framework for Mutual Improvement of SLAM and Semantic Segmentation
- Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects
- SymbioLCD: Ensemble-Based Loop Closure Detection using CNN-Extracted Objects and Visual Bag-of-Words
- Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines
- RGB-D Odometry and SLAM
- Det-SLAM: A semantic visual SLAM for highly dynamic scenes using Detectron2
- DynaVINS++: Robust Visual-Inertial State Estimator in Dynamic Environments by Adaptive Truncated Least Squares and Stable State Recovery
- DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields
- NGD-SLAM: Towards Real-Time Dynamic SLAM without GPU
- Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environments
- Using Detection, Tracking and Prediction in Visual SLAM to Achieve Real-time Semantic Mapping of Dynamic Scenarios
- WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
- Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAM
- RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
- ParkingTwin: Training-Free Streaming 3D Reconstruction for Parking-Lot Digital Twins
- The SLAM Confidence Trap