Robust Face Alignment Using a Mixture of Invariant Experts
arXiv:1511.04404 · doi:10.1007/978-3-319-46454-1_50
Abstract
Face alignment, which is the task of finding the locations of a set of facial landmark points in an image of a face, is useful in widespread application areas. Face alignment is particularly challenging when there are large variations in pose (in-plane and out-of-plane rotations) and facial expression. To address this issue, we propose a cascade in which each stage consists of a mixture of regression experts. Each expert learns a customized regression model that is specialized to a different subset of the joint space of pose and expressions. The system is invariant to a predefined class of transformations (e.g., affine), because the input is transformed to match each expert's prototype shape before the regression is applied. We also present a method to include deformation constraints within the discriminative alignment framework, which makes our algorithm more robust. Our algorithm significantly outperforms previous methods on publicly available face alignment datasets.
arXiv comment17 pages, 6 figures
References in corpus (1)
Cited by in corpus (10)
- Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition
- Facial Landmarks Localization using Cascaded Neural Networks
- Verification of Very Low-Resolution Faces Using An Identity-Preserving Deep Face Super-Resolution Network
- LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihood
- Interspecies Knowledge Transfer for Facial Keypoint Detection
- Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning
- Dynamic Attention-controlled Cascaded Shape Regression Exploiting Training Data Augmentation and Fuzzy-set Sample Weighting
- Deep Imbalanced Attribute Classification using Visual Attention Aggregation
- LDDMM-Face: Large Deformation Diffeomorphic Metric Learning for Flexible and Consistent Face Alignment
- Self-Reinforced Cascaded Regression for Face Alignment