Robust Face Alignment Using a Mixture of Invariant Experts
arXiv:1511.04404 · doi:10.1007/978-3-319-46454-1_50
Abstract
Face alignment, which is the task of finding the locations of a set of facial landmark points in an image of a face, is useful in widespread application areas. Face alignment is particularly challenging when there are large variations in pose (in-plane and out-of-plane rotations) and facial expression. To address this issue, we propose a cascade in which each stage consists of a mixture of regression experts. Each expert learns a customized regression model that is specialized to a different subset of the joint space of pose and expressions. The system is invariant to a predefined class of transformations (e.g., affine), because the input is transformed to match each expert's prototype shape before the regression is applied. We also present a method to include deformation constraints within the discriminative alignment framework, which makes our algorithm more robust. Our algorithm significantly outperforms previous methods on publicly available face alignment datasets.
17 pages, 6 figures
References in corpus (1)
Cited by in corpus (10)
- Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition
- Facial Landmarks Localization using Cascaded Neural Networks
- Verification of Very Low-Resolution Faces Using An Identity-Preserving Deep Face Super-Resolution Network
- LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihood
- Interspecies Knowledge Transfer for Facial Keypoint Detection
- Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning
- Dynamic Attention-controlled Cascaded Shape Regression Exploiting Training Data Augmentation and Fuzzy-set Sample Weighting
- Deep Imbalanced Attribute Classification using Visual Attention Aggregation
- LDDMM-Face: Large Deformation Diffeomorphic Metric Learning for Flexible and Consistent Face Alignment
- Self-Reinforced Cascaded Regression for Face Alignment