SAFENet: Self-Supervised Monocular Depth Estimation with Semantic-Aware Feature Extraction

Abstract

Self-supervised monocular depth estimation has emerged as a promising method because it does not require groundtruth depth maps during training. As an alternative for the groundtruth depth map, the photometric loss enables to provide self-supervision on depth prediction by matching the input image frames. However, the photometric loss causes various problems, resulting in less accurate depth values compared with supervised approaches. In this paper, we propose SAFENet that is designed to leverage semantic information to overcome the limitations of the photometric loss. Our key idea is to exploit semantic-aware depth features that integrate the semantic and geometric knowledge. Therefore, we introduce multi-task learning schemes to incorporate semantic-awareness into the representation of depth features. Experiments on KITTI dataset demonstrate that our methods compete or even outperform the state-of-the-art methods. Furthermore, extensive experiments on different datasets show its better generalization ability and robustness to various conditions, such as low-light or adverse weather.

References in corpus (8)

• Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
• DeMoN: Depth and Motion Network for Learning Monocular Stereo
• Learning multiple visual domains with residual adapters
• Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
• Virtual Worlds as Proxy for Multi-Object Tracking Analysis
• Deep Ordinal Regression Network for Monocular Depth Estimation
• Semantically-Guided Representation Learning for Self-Supervised Monocular Depth
• ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systems

Cited by in corpus (6)

• Self-Supervised Monocular Depth Estimation with Self-Reference Distillation and Disparity Offset Refinement
• Self-Supervised Monocular Depth Estimation with Internal Feature Fusion
• Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidance
• Instance-aware multi-object self-supervision for monocular depth prediction
• CI-Net: Contextual Information for Joint Semantic Segmentation and Depth Estimation
• SUB-Depth: Self-distillation and Uncertainty Boosting Self-supervised Monocular Depth Estimation