Unsupervised Learning of Camera Pose with Compositional Re-estimation
arXiv:2001.06479
Abstract
We consider the problem of unsupervised camera pose estimation. Given an input video sequence, our goal is to estimate the camera pose (i.e. the camera motion) between consecutive frames. Traditionally, this problem is tackled by placing strict constraints on the transformation vector or by incorporating optical flow through a complex pipeline. We propose an alternative approach that utilizes a compositional re-estimation process for camera pose estimation. Given an input, we first estimate a depth map. Our method then iteratively estimates the camera motion based on the estimated depth map. Our approach significantly improves the predicted camera motion both quantitatively and visually. Furthermore, the re-estimation resolves the problem of out-of-boundaries pixels in a novel and simple way. Another advantage of our approach is that it is adaptable to other camera pose estimation approaches. Experimental analysis on KITTI benchmark dataset demonstrates that our method outperforms existing state-of-the-art approaches in unsupervised camera ego-motion estimation.
arXiv commentAccepted to WACV 2020
References in corpus (9)
- Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
- On the Convergence of Adam and Beyond
- Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields
- DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networks
- DeMoN: Depth and Motion Network for Learning Monocular Stereo
- SfM-Net: Learning of Structure and Motion from Video
- Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
- BA-Net: Dense Bundle Adjustment Network
- Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction