Monocular Depth Estimation using Multi-Scale Continuous CRFs as Sequential Deep Networks
arXiv:1803.00891
Abstract
Depth cues have been proved very useful in various computer vision and robotic tasks. This paper addresses the problem of monocular depth estimation from a single still image. Inspired by the effectiveness of recent works on multi-scale convolutional neural networks (CNN), we propose a deep model which fuses complementary information derived from multiple CNN side outputs. Different from previous methods using concatenation or weighted average schemes, the integration is obtained by means of continuous Conditional Random Fields (CRFs). In particular, we propose two different variations, one based on a cascade of multiple CRFs, the other on a unified graphical model. By designing a novel CNN implementation of mean-field updates for continuous CRFs, we show that both proposed models can be regarded as sequential deep networks and that training can be performed end-to-end. Through an extensive experimental evaluation, we demonstrate the effectiveness of the proposed approach and establish new state of the art results for the monocular depth estimation task on three publicly available datasets, i.e. NYUD-V2, Make3D and KITTI.
arXiv admin note: substantial text overlap with arXiv:1704.02157
References in corpus (9)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
- Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
- Learning Deconvolution Network for Semantic Segmentation
- DepthTransfer: Depth Extraction from Video Using Non-parametric Sampling
- Fully Connected Deep Structured Networks
- Unsupervised Learning of Depth and Ego-Motion from Video
- Semi-Supervised Deep Learning for Monocular Depth Map Prediction
- Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation