Fully Automatic Expression-Invariant Face Correspondence

Abstract

We consider the problem of computing accurate point-to-point correspondences among a set of human face scans with varying expressions. Our fully automatic approach does not require any manually placed markers on the scan. Instead, the approach learns the locations of a set of landmarks present in a database and uses this knowledge to automatically predict the locations of these landmarks on a newly available scan. The predicted landmarks are then used to compute point-to-point correspondences between a template model and the newly available scan. To accurately fit the expression of the template to the expression of the scan, we use as template a blendshape model. Our algorithm was tested on a database of human faces of different ethnic groups with strongly varying expressions. Experimental results show that the obtained point-to-point correspondence is both highly accurate and consistent for most of the tested 3D face models.

Cited by in corpus (7)

• Dense 3D Face Correspondence
• Review of Statistical Shape Spaces for 3D Data with Comparative Analysis for Human Faces
• Multi-view consensus CNN for 3D facial landmark placement
• A Sparse and Locally Coherent Morphable Face Model for Dense Semantic Correspondence Across Heterogeneous 3D Faces
• A Decoupled 3D Facial Shape Model by Adversarial Training
• Towards Fine-grained 3D Face Dense Registration: An Optimal Dividing and Diffusing Method
• Topologically Consistent Multi-View Face Inference Using Volumetric Sampling