RGB-D Odometry and SLAM
arXiv:2001.06875 · doi:10.1007/978-3-030-28603-3_6
Abstract
The emergence of modern RGB-D sensors had a significant impact in many application fields, including robotics, augmented reality (AR) and 3D scanning. They are low-cost, low-power and low-size alternatives to traditional range sensors such as LiDAR. Moreover, unlike RGB cameras, RGB-D sensors provide the additional depth information that removes the need of frame-by-frame triangulation for 3D scene reconstruction. These merits have made them very popular in mobile robotics and AR, where it is of great interest to estimate ego-motion and 3D scene structure. Such spatial understanding can enable robots to navigate autonomously without collisions and allow users to insert virtual entities consistent with the image stream. In this chapter, we review common formulations of odometry and Simultaneous Localization and Mapping (known by its acronym SLAM) using RGB-D stream input. The two topics are closely related, as the former aims to track the incremental camera motion with respect to a local map of the scene, and the latter to jointly estimate the camera trajectory and the global map with consistency. In both cases, the standard approaches minimize a cost function using nonlinear optimization techniques. This chapter consists of three main parts: In the first part, we introduce the basic concept of odometry and SLAM and motivate the use of RGB-D sensors. We also give mathematical preliminaries relevant to most odometry and SLAM algorithms. In the second part, we detail the three main components of SLAM systems: camera pose tracking, scene mapping and loop closing. For each component, we describe different approaches proposed in the literature. In the final part, we provide a brief discussion on advanced research topics with the references to the state-of-the-art.
This is the pre-submission version of the manuscript that was later edited and published as a chapter in RGB-D Image Analysis and Processing
References in corpus (10)
- ORB-SLAM: a Versatile and Accurate Monocular SLAM System
- ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes
- Matterport3D: Learning from RGB-D Data in Indoor Environments
- A micro Lie theory for state estimation in robotics
- Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignment
- BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integration
- PlaneMatch: Patch Coplanarity Prediction for Robust RGB-D Reconstruction
- RGBiD-SLAM for Accurate Real-time Localisation and 3D Mapping