SuMa++: Efficient LiDAR-based Semantic SLAM
arXiv:2105.11320 · doi:10.1109/IROS40897.2019.8967704
Abstract
Reliable and accurate localization and mapping are key components of most autonomous systems. Besides geometric information about the mapped environment, the semantics plays an important role to enable intelligent navigation behaviors. In most realistic environments, this task is particularly complicated due to dynamics caused by moving objects, which can corrupt the mapping step or derail localization. In this paper, we propose an extension of a recently published surfel-based mapping approach exploiting three-dimensional laser range scans by integrating semantic information to facilitate the mapping process. The semantic information is efficiently extracted by a fully convolutional neural network and rendered on a spherical projection of the laser range data. This computed semantic segmentation results in point-wise labels for the whole scan, allowing us to build a semantically-enriched map with labeled surfels. This semantic map enables us to reliably filter moving objects, but also improve the projective scan matching via semantic constraints. Our experimental evaluation on challenging highways sequences from KITTI dataset with very few static structures and a large amount of moving cars shows the advantage of our semantic SLAM approach in comparison to a purely geometric, state-of-the-art approach.
Accepted by IROS 2019. Code: https://github.com/PRBonn/semantic_suma
References in corpus (4)
Cited by in corpus (32)
- KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Way
- Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data
- OverlapNet: Loop Closing for LiDAR-based SLAM
- OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognition
- Range Image-based LiDAR Localization for Autonomous Vehicles
- Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentation
- Dynamic Object Aware LiDAR SLAM based on Automatic Generation of Training Data
- PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency
- Efficient LiDAR Odometry for Autonomous Driving
- Globally Consistent 3D LiDAR Mapping with GPU-accelerated GICP Matching Cost Factors
- Building Volumetric Beliefs for Dynamic Environments Exploiting Map-Based Moving Object Segmentation
- PADLoC: LiDAR-Based Deep Loop Closure Detection and Registration Using Panoptic Attention
- Learning an Overlap-based Observation Model for 3D LiDAR Localization
- Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation
- Collaborative Dynamic 3D Scene Graphs for Automated Driving
- Online Range Image-based Pole Extractor for Long-term LiDAR Localization in Urban Environments
- Mobile-Seed: Joint Semantic Segmentation and Boundary Detection for Mobile Robots
- MotionBEV: Attention-Aware Online LiDAR Moving Object Segmentation with Bird's Eye View based Appearance and Motion Features
- Active Metric-Semantic Mapping by Multiple Aerial Robots
- ROLO-SLAM: Rotation-Optimized LiDAR-Only SLAM in Uneven Terrain with Ground Vehicle
- GOReloc: Graph-based Object-Level Relocalization for Visual SLAM
- Simple But Effective Redundant Odometry for Autonomous Vehicles
- A flexible framework for accurate LiDAR odometry, map manipulation, and localization
- Fail-Aware LIDAR-Based Odometry for Autonomous Vehicles
- SGBA: Semantic Gaussian Mixture Model-Based LiDAR Bundle Adjustment
- LiDAR Loop Closure Detection using Semantic Graphs with Graph Attention Networks
- Online Robust Sliding-Windowed LiDAR SLAM in Natural Environments
- WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
- Semantic Exploration and Dense Mapping of Complex Environments using Ground Robot with Panoramic LiDAR-Camera Fusion
- Object-Oriented Grid Mapping in Dynamic Environments
- Localization Under Consistent Assumptions Over Dynamics
- RAI-Net: Range-Adaptive LiDAR Point Cloud Frame Interpolation Network