DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
arXiv:1809.08379 · doi:10.1109/IROS.2018.8593691
Abstract
Simultaneous Localization and Mapping (SLAM) is considered to be a fundamental capability for intelligent mobile robots. Over the past decades, many impressed SLAM systems have been developed and achieved good performance under certain circumstances. However, some problems are still not well solved, for example, how to tackle the moving objects in the dynamic environments, how to make the robots truly understand the surroundings and accomplish advanced tasks. In this paper, a robust semantic visual SLAM towards dynamic environments named DS-SLAM is proposed. Five threads run in parallel in DS-SLAM: tracking, semantic segmentation, local mapping, loop closing, and dense semantic map creation. DS-SLAM combines semantic segmentation network with moving consistency check method to reduce the impact of dynamic objects, and thus the localization accuracy is highly improved in dynamic environments. Meanwhile, a dense semantic octo-tree map is produced, which could be employed for high-level tasks. We conduct experiments both on TUM RGB-D dataset and in the real-world environment. The results demonstrate the absolute trajectory accuracy in DS-SLAM can be improved by one order of magnitude compared with ORB-SLAM2. It is one of the state-of-the-art SLAM systems in high-dynamic environments. Now the code is available at our github: https://github.com/ivipsourcecode/DS-SLAM
arXiv comment7 pages, accepted at the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018). Now the code is available at our github: https://github.com/ivipsourcecode/DS-SLAM
References in corpus (3)
Cited by in corpus (52)
- SuMa++: Efficient LiDAR-based Semantic SLAM
- Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
- Visual SLAM: What are the Current Trends and What to Expect?
- Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
- RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments
- Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera
- RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
- TwistSLAM: Constrained SLAM in Dynamic Environment
- Fast ORB-SLAM without Keypoint Descriptors
- NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environments
- A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
- Panoramic annular SLAM with loop closure and global optimization
- An Online Semantic Mapping System for Extending and Enhancing Visual SLAM
- Anchor-Based Spatio-Temporal Attention 3D Convolutional Networks for Dynamic 3D Point Cloud Sequences
- Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM
- Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects
- On Incremental Structure-from-Motion using Lines
- Movable-Object-Aware Visual SLAM via Weakly Supervised Semantic Segmentation
- Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines
- Det-SLAM: A semantic visual SLAM for highly dynamic scenes using Detectron2
- NGD-SLAM: Towards Real-Time Dynamic SLAM without GPU
- DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields
- FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flow
- DXSLAM: A Robust and Efficient Visual SLAM System with Deep Features
- MoRPI: Mobile Robot Pure Inertial Navigation
- Learning to Segment Dynamic Objects using SLAM Outliers
- Semantic Nearest Neighbor Fields Monocular Edge Visual-Odometry
- Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environments
- A Benchmark Dataset for Collaborative SLAM in Service Environments
- Using Detection, Tracking and Prediction in Visual SLAM to Achieve Real-time Semantic Mapping of Dynamic Scenarios
- UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments
- Vision-based Situational Graphs Exploiting Fiducial Markers for the Integration of Semantic Entities
- ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings
- Removing Dynamic Objects for Static Scene Reconstruction using Light Fields
- DymSLAM:4D Dynamic Scene Reconstruction Based on Geometrical Motion Segmentation
- View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements
- Identification and Avoidance of Static and Dynamic Obstacles on Point Cloud for UAVs Navigation
- WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
- GMC: Grid Based Motion Clustering in Dynamic Environment
- RSV-SLAM: Toward Real-Time Semantic Visual SLAM in Indoor Dynamic Environments
- SplitFusion: Simultaneous Tracking and Mapping for Non-Rigid Scenes
- SimVODIS: Simultaneous Visual Odometry, Object Detection, and Instance Segmentation
- Embracing Dynamics: Dynamics-aware 4D Gaussian Splatting SLAM
- Salient Bundle Adjustment for Visual SLAM
- A Light Field Front-end for Robust SLAM in Dynamic Environments
- Robust 3D Scene Segmentation through Hierarchical and Learnable Part-Fusion
- Real-time Identification and Simultaneous Avoidance of Static and Dynamic Obstacles on Point Cloud for UAVs Navigation
- AcousticFusion: Fusing Sound Source Localization to Visual SLAM in Dynamic Environments
- ViLiVO: Virtual LiDAR-Visual Odometry for an Autonomous Vehicle with a Multi-Camera System
- Enhanced Unscented Kalman Filter-Based SLAM in Dynamic Environments: Euclidean Approach
- Semantic Flow-guided Motion Removal Method for Robust Mapping
- The STDyn-SLAM: A stereo vision and semantic segmentation approach for SLAM in dynamic outdoor environments