Self-Supervised Monocular Image Depth Learning and Confidence Estimation
arXiv:1803.05530
Abstract
Convolutional Neural Networks (CNNs) need large amounts of data with ground truth annotation, which is a challenging problem that has limited the development and fast deployment of CNNs for many computer vision tasks. We propose a novel framework for depth estimation from monocular images with corresponding confidence in a self-supervised manner. A fully differential patch-based cost function is proposed by using the Zero-Mean Normalized Cross Correlation (ZNCC) that takes multi-scale patches as a matching strategy. This approach greatly increases the accuracy and robustness of the depth learning. In addition, the proposed patch-based cost function can provide a 0 to 1 confidence, which is then used to supervise the training of a parallel network for confidence map learning and estimation. Evaluation on KITTI dataset shows that our method outperforms the state-of-the-art results.
References in corpus (7)
- Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
- End-to-End Learning of Geometry and Context for Deep Stereo Regression
- Single-Image Depth Perception in the Wild
- Semi-Supervised Deep Learning for Monocular Depth Map Prediction
- CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction
- Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation
- Single View Stereo Matching