An Experimental Evaluation of Covariates Effects on Unconstrained Face Verification

Abstract

Covariates are factors that have a debilitating influence on face verification performance. In this paper, we comprehensively study two covariate related problems for unconstrained face verification: first, how covariates affect the performance of deep neural networks on the large-scale unconstrained face verification problem; second, how to utilize covariates to improve verification performance. To study the first problem, we implement five state-of-the-art deep convolutional networks (DCNNs) for face verification and evaluate them on three challenging covariates datasets. In total, seven covariates are considered: pose (yaw and roll), age, facial hair, gender, indoor/outdoor, occlusion (nose and mouth visibility, eyes visibility, and forehead visibility), and skin tone. These covariates cover both intrinsic subject-specific characteristics and extrinsic factors of faces. Some of the results confirm and extend the findings of previous studies, others are new findings that were rarely mentioned previously or did not show consistent trends. For the second problem, we demonstrate that with the assistance of gender information, the quality of a pre-curated noisy large-scale face dataset for face recognition can be further improved. After retraining the face recognition model using the curated data, performance improvement is observed at low False Acceptance Rates (FARs) (FAR=$10^{-5}$, $10^{-6}$, $10^{-7}$).

References in corpus (6)

• DeepID3: Face Recognition with Very Deep Neural Networks
• L2-constrained Softmax Loss for Discriminative Face Verification
• Strengths and Weaknesses of Deep Learning Models for Face Recognition Against Image Degradations
• Triplet Probabilistic Embedding for Face Verification and Clustering
• MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
• Deep Convolutional Neural Network Features and the Original Image

Cited by in corpus (15)

• Demographic Bias in Biometrics: A Survey on an Emerging Challenge
• Deep Feature Space: A Geometrical Perspective
• Gendered Differences in Face Recognition Accuracy Explained by Hairstyles, Makeup, and Facial Morphology
• Deep multi-metric learning for text-independent speaker verification
• Algorithmic Discrimination: Formulation and Exploration in Deep Learning-based Face Biometrics
• Unsupervised Domain-Specific Deblurring via Disentangled Representations
• Review of Demographic Fairness in Face Recognition
• Deep Face Recognition Model Compression via Knowledge Transfer and Distillation
• Learning Fair Face Representation With Progressive Cross Transformer
• Analysis of Manual and Automated Skin Tone Assignments for Face Recognition Applications
• Demographic Bias in Presentation Attack Detection of Iris Recognition Systems
• Facial Expressions as a Vulnerability in Face Recognition
• SELM: Siamese Extreme Learning Machine with Application to Face Biometrics
• Does Face Recognition Error Echo Gender Classification Error?
• Matched sample selection with GANs for mitigating attribute confounding