Do We Really Need to Collect Millions of Faces for Effective Face Recognition?

Abstract

Face recognition capabilities have recently made extraordinary leaps. Though this progress is at least partially due to ballooning training set sizes -- huge numbers of face images downloaded and labeled for identity -- it is not clear if the formidable task of collecting so many images is truly necessary. We propose a far more accessible means of increasing training data sizes for face recognition systems. Rather than manually harvesting and labeling more faces, we simply synthesize them. We describe novel methods of enriching an existing dataset with important facial appearance variations by manipulating the faces it contains. We further apply this synthesis approach when matching query images represented using a standard convolutional neural network. The effect of training and testing with synthesized images is extensively tested on the LFW and IJB-A (verification and identification) benchmarks and Janus CS2. The performances obtained by our approach match state of the art results reported by systems trained on millions of downloaded images.

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Learning Face Representation from Scratch
• DeepID3: Face Recognition with Very Deep Neural Networks
• Return of the Devil in the Details: Delving Deep into Convolutional Nets
• Multi-view Convolutional Neural Networks for 3D Shape Recognition
• Naive-Deep Face Recognition: Touching the Limit of LFW Benchmark or Not?
• Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture
• Face Search at Scale: 80 Million Gallery
• Triplet Similarity Embedding for Face Verification
• Face Recognition Using Deep Multi-Pose Representations
• Mirror, mirror on the wall, tell me, is the error small?

Cited by in corpus (33)

• Deep Facial Expression Recognition: A Survey
• Reversing the Irreversible: A Survey on Inverse Biometrics
• von Mises-Fisher Mixture Model-based Deep learning: Application to Face Verification
• Training Deep Face Recognition Systems with Synthetic Data
• Minimum Margin Loss for Deep Face Recognition
• Neural Aggregation Network for Video Face Recognition
• Sampling Strategies for GAN Synthetic Data
• Neural Face Editing with Intrinsic Image Disentangling
• Maximum A Posteriori Estimation of Distances Between Deep Features in Still-to-Video Face Recognition
• Striking the Right Balance with Uncertainty
• Deep Learning For Face Recognition: A Critical Analysis
• Pose-Robust Face Recognition via Deep Residual Equivariant Mapping
• FacePoseNet: Making a Case for Landmark-Free Face Alignment
• Max-margin Class Imbalanced Learning with Gaussian Affinity
• On Face Segmentation, Face Swapping, and Face Perception
• Video Face Recognition: Component-wise Feature Aggregation Network (C-FAN)
• Attention Control with Metric Learning Alignment for Image Set-based Recognition
• Dependency-aware Attention Control for Unconstrained Face Recognition with Image Sets
• ExpNet: Landmark-Free, Deep, 3D Facial Expressions
• Deep 3D Face Identification
• Multi-Prototype Networks for Unconstrained Set-based Face Recognition
• Design Identification of Curve Patterns on Cultural Heritage Objects: Combining Template Matching and CNN-based Re-Ranking
• UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition
• Extreme 3D Face Reconstruction: Seeing Through Occlusions
• Interspecies Knowledge Transfer for Facial Keypoint Detection
• Improving Face Detection Performance with 3D-Rendered Synthetic Data
• A Fast and Accurate System for Face Detection, Identification, and Verification
• Fully Associative Patch-based 1-to-N Matcher for Face Recognition
• Unsupervised Learning of Face Representations
• AFFACT - Alignment-Free Facial Attribute Classification Technique
• Fast Face Image Synthesis with Minimal Training
• Face Detection and Face Recognition In the Wild Using Off-the-Shelf Freely Available Components
• LEGAN: Disentangled Manipulation of Directional Lighting and Facial Expressions by Leveraging Human Perceptual Judgements