Single Image Depth Estimation Trained via Depth from Defocus Cues

Abstract

Estimating depth from a single RGB images is a fundamental task in computer vision, which is most directly solved using supervised deep learning. In the field of unsupervised learning of depth from a single RGB image, depth is not given explicitly. Existing work in the field receives either a stereo pair, a monocular video, or multiple views, and, using losses that are based on structure-from-motion, trains a depth estimation network. In this work, we rely, instead of different views, on depth from focus cues. Learning is based on a novel Point Spread Function convolutional layer, which applies location specific kernels that arise from the Circle-Of-Confusion in each image location. We evaluate our method on data derived from five common datasets for depth estimation and lightfield images, and present results that are on par with supervised methods on KITTI and Make3D datasets and outperform unsupervised learning approaches. Since the phenomenon of depth from defocus is not dataset specific, we hypothesize that learning based on it would overfit less to the specific content in each dataset. Our experiments show that this is indeed the case, and an estimator learned on one dataset using our method provides better results on other datasets, than the directly supervised methods.

References in corpus (12)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• Deep Residual Learning for Image Recognition
• Densely Connected Convolutional Networks
• Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
• Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
• Unsupervised Learning of Depth and Ego-Motion from Video
• Dual Attention Network for Scene Segmentation
• Deep Ordinal Regression Network for Monocular Depth Estimation
• Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture
• Semi-Supervised Deep Learning for Monocular Depth Map Prediction
• Learning Depth from Monocular Videos using Direct Methods
• Depth estimation using structured light flow -- analysis of projected pattern flow on an object's surface --