Self-Supervised Joint Learning Framework of Depth Estimation via Implicit Cues

Abstract

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network. Compared with static views, abundant dynamic properties between video frames are beneficial to refined depth estimation, especially for dynamic objects. In this work, we propose a novel self-supervised joint learning framework for depth estimation using consecutive frames from monocular and stereo videos. The main idea is using an implicit depth cue extractor which leverages dynamic and static cues to generate useful depth proposals. These cues can predict distinguishable motion contours and geometric scene structures. Furthermore, a new high-dimensional attention module is introduced to extract clear global transformation, which effectively suppresses uncertainty of local descriptors in high-dimensional space, resulting in a more reliable optimization in learning framework. Experiments demonstrate that the proposed framework outperforms the state-of-the-art(SOTA) on KITTI and Make3D datasets.

References in corpus (6)

• Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
• Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
• The Cityscapes Dataset for Semantic Urban Scene Understanding
• Mixed High-Order Attention Network for Person Re-Identification
• Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Camera
• Unsupervised High-Resolution Depth Learning From Videos With Dual Networks

Cited by in corpus (4)

• Self-Supervised Monocular Depth Estimation with Internal Feature Fusion
• DS-Depth: Dynamic and Static Depth Estimation via a Fusion Cost Volume
• DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications
• On the Coupling of Depth and Egomotion Networks for Self-Supervised Structure from Motion