Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey
arXiv:2406.19675 · doi:10.1145/3677327
Abstract
Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based papers have been published in the past 10 years, which indicates the growing interest in the task. This paper presents a comprehensive survey of the existing deep learning-based methods, the challenges they address, and how they have evolved in their architecture and supervision methods. It provides a taxonomy for classifying the current work based on their input and output modalities, network architectures, and learning methods. It also discusses the major milestones in the history of monocular depth estimation, and different pipelines, datasets, and evaluation metrics used in existing methods.
arXiv comment46 pages, 10 figures, The paper has been accepted for publication in ACM Computing Surveys 2024
References in corpus (29)
- Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
- Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
- The ApolloScape Open Dataset for Autonomous Driving and its Application
- DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling
- From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimation
- Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
- A Survey on Deep Learning Techniques for Stereo-based Depth Estimation
- Monocular Depth Estimation Based On Deep Learning: An Overview
- Intriguing Properties of Vision Transformers
- Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Video
- Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistency
- Unsupervised Learning of Depth, Optical Flow and Pose with Occlusion from 3D Geometry
- Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networks
- Rethinking Monocular Depth Estimation with Adversarial Training
- TransformerFusion: Monocular RGB Scene Reconstruction using Transformers
- Monocular Depth Estimation using Multi-Scale Continuous CRFs as Sequential Deep Networks
- Consistent Depth of Moving Objects in Video
- Attention-based Context Aggregation Network for Monocular Depth Estimation
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data
- IEBins: Iterative Elastic Bins for Monocular Depth Estimation
- The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation
- Lightweight Monocular Depth Estimation Model by Joint End-to-End Filter pruning
- Outdoor Monocular Depth Estimation: A Research Review
- Deep Digging into the Generalization of Self-Supervised Monocular Depth Estimation
- Semi-Supervised Adversarial Monocular Depth Estimation
- SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenes
- Online Mutual Adaptation of Deep Depth Prediction and Visual SLAM
- iDisc: Internal Discretization for Monocular Depth Estimation
- A Study on the Generality of Neural Network Structures for Monocular Depth Estimation