Unsupervised Monocular Depth Learning in Dynamic Scenes
arXiv:2010.16404
Abstract
We present a method for jointly training the estimation of depth, ego-motion, and a dense 3D translation field of objects relative to the scene, with monocular photometric consistency being the sole source of supervision. We show that this apparently heavily underdetermined problem can be regularized by imposing the following prior knowledge about 3D translation fields: they are sparse, since most of the scene is static, and they tend to be constant for rigid moving objects. We show that this regularization alone is sufficient to train monocular depth prediction models that exceed the accuracy achieved in prior work for dynamic scenes, including methods that require semantic input. Code is at https://github.com/google-research/google-research/tree/master/depth_and_motion_learning .
Accepted at 4th Conference on Robot Learning (CoRL 2020)
References in corpus (9)
- Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
- Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
- DeMoN: Depth and Motion Network for Learning Monocular Stereo
- Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
- End-to-End Learning of Geometry and Context for Deep Stereo Regression
- Scalability in Perception for Autonomous Driving: Waymo Open Dataset
- Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Video
- Unsupervised Learning of Geometry with Edge-aware Depth-Normal Consistency
- StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Prediction