Real-Time Metric-Semantic Mapping for Autonomous Navigation in Outdoor Environments

Abstract

The creation of a metric-semantic map, which encodes human-prior knowledge, represents a high-level abstraction of environments. However, constructing such a map poses challenges related to the fusion of multi-modal sensor data, the attainment of real-time mapping performance, and the preservation of structural and semantic information consistency. In this paper, we introduce an online metric-semantic mapping system that utilizes LiDAR-Visual-Inertial sensing to generate a global metric-semantic mesh map of large-scale outdoor environments. Leveraging GPU acceleration, our mapping process achieves exceptional speed, with frame processing taking less than 7ms, regardless of scenario scale. Furthermore, we seamlessly integrate the resultant map into a real-world navigation system, enabling metric-semantic-based terrain assessment and autonomous point-to-point navigation within a campus environment. Through extensive experiments conducted on both publicly available and self-collected datasets comprising 24 sequences, we demonstrate the effectiveness of our mapping and navigation methodologies. Code has been publicly released: https://github.com/gogojjh/cobra

12 pages, 9 figures, accepted to IEEE Transactions on Automation Science and Engineering

References in corpus (9)

• Voxblox: Incremental 3D Euclidean Signed Distance Fields for On-Board MAV Planning
• Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Data
• Volumetric Instance-Aware Semantic Mapping and 3D Object Discovery
• Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mapping
• Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistency
• The Role of the Hercules Autonomous Vehicle During the COVID-19 Pandemic: An Autonomous Logistic Vehicle for Contactless Goods Transportation
• Real-time Neural Dense Elevation Mapping for Urban Terrain with Uncertainty Estimations
• PALoc: Advancing SLAM Benchmarking with Prior-Assisted 6-DoF Trajectory Generation and Uncertainty Estimation
• Multitask Learning for Scalable and Dense Multilayer Bayesian Map Inference