Approaches, Challenges, and Applications for Deep Visual Odometry: Toward to Complicated and Emerging Areas

Abstract

Visual odometry (VO) is a prevalent way to deal with the relative localization problem, which is becoming increasingly mature and accurate, but it tends to be fragile under challenging environments. Comparing with classical geometry-based methods, deep learning-based methods can automatically learn effective and robust representations, such as depth, optical flow, feature, ego-motion, etc., from data without explicit computation. Nevertheless, there still lacks a thorough review of the recent advances of deep learning-based VO (Deep VO). Therefore, this paper aims to gain a deep insight on how deep learning can profit and optimize the VO systems. We first screen out a number of qualifications including accuracy, efficiency, scalability, dynamicity, practicability, and extensibility, and employ them as the criteria. Then, using the offered criteria as the uniform measurements, we detailedly evaluate and discuss how deep learning improves the performance of VO from the aspects of depth estimation, feature extraction and matching, pose estimation. We also summarize the complicated and emerging areas of Deep VO, such as mobile robots, medical robots, augmented reality and virtual reality, etc. Through the literature decomposition, analysis, and comparison, we finally put forward a number of open issues and raise some future research directions in this field.

References in corpus (11)

• ORB-SLAM: a Versatile and Accurate Monocular SLAM System
• Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
• Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
• DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
• DeMoN: Depth and Motion Network for Learning Monocular Stereo
• VLocNet++: Deep Multitask Learning for Semantic Visual Localization and Odometry
• Learning Depth from Single Images with Deep Neural Network Embedding Focal Length
• The Adaptability and Challenges of Autonomous Vehicles to Pedestrians in Urban China
• DPC-Net: Deep Pose Correction for Visual Localization
• A feature-supervised generative adversarial network for environmental monitoring during hazy days
• Depth from Monocular Images using a Semi-Parallel Deep Neural Network (SPDNN) Hybrid Architecture

Cited by in corpus (5)

• Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach
• Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines
• Online Learning of Wheel Odometry Correction for Mobile Robots with Attention-based Neural Network
• Active Illumination for Visual Ego-Motion Estimation in the Dark
• Mapping the ocular surface from monocular videos with an application to dry eye disease grading