Prior-Guided Multi-View 3D Head Reconstruction
arXiv:2107.04277 · doi:10.1109/TMM.2021.3111485
Abstract
Recovery of a 3D head model including the complete face and hair regions is still a challenging problem in computer vision and graphics. In this paper, we consider this problem using only a few multi-view portrait images as input. Previous multi-view stereo methods that have been based, either on optimization strategies or deep learning techniques, suffer from low-frequency geometric structures such as unclear head structures and inaccurate reconstruction in hair regions. To tackle this problem, we propose a prior-guided implicit neural rendering network. Specifically, we model the head geometry with a learnable signed distance field (SDF) and optimize it via an implicit differentiable renderer with the guidance of some human head priors, including the facial prior knowledge, head semantic segmentation information and 2D hair orientation maps. The utilization of these priors can improve the reconstruction accuracy and robustness, leading to a high-quality integrated 3D head model. Extensive ablation studies and comparisons with state-of-the-art methods demonstrate that our method can generate high-fidelity 3D head geometries with the guidance of these priors.
arXiv comment13 pages, 14 figures
References in corpus (6)
- How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)
- 3D Face Reconstruction with Geometry Details from a Single Image
- 3D Face Reconstruction from A Single Image Assisted by 2D Face Images in the Wild
- Learning Unsupervised Multi-View Stereopsis via Robust Photometric Consistency
- Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction
- M^3VSNet: Unsupervised Multi-metric Multi-view Stereo Network