SegMap: Segment-based mapping and localization using data-driven descriptors
arXiv:1909.12837 · doi:10.1177/0278364919863090
Abstract
Precisely estimating a robot's pose in a prior, global map is a fundamental capability for mobile robotics, e.g. autonomous driving or exploration in disaster zones. This task, however, remains challenging in unstructured, dynamic environments, where local features are not discriminative enough and global scene descriptors only provide coarse information. We therefore present SegMap: a map representation solution for localization and mapping based on the extraction of segments in 3D point clouds. Working at the level of segments offers increased invariance to view-point and local structural changes, and facilitates real-time processing of large-scale 3D data. SegMap exploits a single compact data-driven descriptor for performing multiple tasks: global localization, 3D dense map reconstruction, and semantic information extraction. The performance of SegMap is evaluated in multiple urban driving and search and rescue experiments. We show that the learned SegMap descriptor has superior segment retrieval capabilities, compared to state-of-the-art handcrafted descriptors. In consequence, we achieve a higher localization accuracy and a 6% increase in recall over state-of-the-art. These segment-based localizations allow us to reduce the open-loop odometry drift by up to 50%. SegMap is open-source available along with easy to run demonstrations.
arXiv admin note: substantial text overlap with arXiv:1804.09557
References in corpus (7)
- FaceNet: A Unified Embedding for Face Recognition and Clustering
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- Learning Descriptors for Object Recognition and 3D Pose Estimation
- SegMatch: Segment based loop-closure for 3D point clouds
- SegMap: 3D Segment Mapping using Data-Driven Descriptors
- LocNet: Global localization in 3D point clouds for mobile vehicles
- An Eigenshapes Approach to Compressed Signed Distance Fields and Their Utility in Robot Mapping
Cited by in corpus (14)
- LoGG3D-Net: Locally Guided Global Descriptor Learning for 3D Place Recognition
- Locus: LiDAR-based Place Recognition using Spatiotemporal Higher-Order Pooling
- DCL-SLAM: A Distributed Collaborative LiDAR SLAM Framework for a Robotic Swarm
- maplab 2.0 -- A Modular and Multi-Modal Mapping Framework
- MinkLoc3D-SI: 3D LiDAR place recognition with sparse convolutions, spherical coordinates, and intensity
- Contour Context: Abstract Structural Distribution for 3D LiDAR Loop Detection and Metric Pose Estimation
- Radar-to-Lidar: Heterogeneous Place Recognition via Joint Learning
- Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems
- Multitask Learning for Scalable and Dense Multilayer Bayesian Map Inference
- FRAME: A Modular Framework for Autonomous Map Merging: Advancements in the Field
- RecNet: An Invertible Point Cloud Encoding through Range Image Embeddings for Multi-Robot Map Sharing and Reconstruction
- G-Loc: Tightly-coupled Graph Localization with Prior Topo-metric Information
- Have We Scene It All? Scene Graph-Aware Deep Point Cloud Compression
- Towards High-Definition Maps: a Framework Leveraging Semantic Segmentation to Improve NDT Map Compression and Descriptivity