Semi-Dense 3D Semantic Mapping from Monocular SLAM
arXiv:1611.04144
Abstract
The bundle of geometry and appearance in computer vision has proven to be a promising solution for robots across a wide variety of applications. Stereo cameras and RGB-D sensors are widely used to realise fast 3D reconstruction and trajectory tracking in a dense way. However, they lack flexibility of seamless switch between different scaled environments, i.e., indoor and outdoor scenes. In addition, semantic information are still hard to acquire in a 3D mapping. We address this challenge by combining the state-of-art deep learning method and semi-dense Simultaneous Localisation and Mapping (SLAM) based on video stream from a monocular camera. In our approach, 2D semantic information are transferred to 3D mapping via correspondence between connective Keyframes with spatial consistency. There is no need to obtain a semantic segmentation for each frame in a sequence, so that it could achieve a reasonable computation time. We evaluate our method on indoor/outdoor datasets and lead to an improvement in the 2D semantic labelling over baseline single frame predictions.
References in corpus (1)
Cited by in corpus (9)
- Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
- Semantics for Robotic Mapping, Perception and Interaction: A Survey
- A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
- Extending Maps with Semantic and Contextual Object Information for Robot Navigation: a Learning-Based Framework using Visual and Depth Cues
- Stereo Vision-based Semantic 3D Object and Ego-motion Tracking for Autonomous Driving
- Semantic 3D Occupancy Mapping through Efficient High Order CRFs
- Fast and Accurate Semantic Mapping through Geometric-based Incremental Segmentation
- Multimodal Sensor-Based Semantic 3D Mapping for a Large-Scale Environment
- Improving Semantic Image Segmentation via Label Fusion in Semantically Textured Meshes