DeepFactors: Real-Time Probabilistic Dense Monocular SLAM

Abstract

The ability to estimate rich geometry and camera motion from monocular imagery is fundamental to future interactive robotics and augmented reality applications. Different approaches have been proposed that vary in scene geometry representation (sparse landmarks, dense maps), the consistency metric used for optimising the multi-view problem, and the use of learned priors. We present a SLAM system that unifies these methods in a probabilistic framework while still maintaining real-time performance. This is achieved through the use of a learned compact depth map representation and reformulating three different types of errors: photometric, reprojection and geometric, which we make use of within standard factor graph software. We evaluate our system on trajectory estimation and depth reconstruction on real-world sequences and present various examples of estimated dense geometry.

RA-L

References in corpus (2)

• ORB-SLAM: a Versatile and Accurate Monocular SLAM System
• DeMoN: Depth and Motion Network for Learning Monocular Stereo

Cited by in corpus (9)

• Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation
• Perception and Navigation in Autonomous Systems in the Era of Learning: A Survey
• Visual SLAM: What are the Current Trends and What to Expect?
• A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
• Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation
• iSLAM: Imperative SLAM
• Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy
• Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines
• Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environments