A Fast and Accurate System for Face Detection, Identification, and Verification

Abstract

The availability of large annotated datasets and affordable computation power have led to impressive improvements in the performance of CNNs on various object detection and recognition benchmarks. These, along with a better understanding of deep learning methods, have also led to improved capabilities of machine understanding of faces. CNNs are able to detect faces, locate facial landmarks, estimate pose, and recognize faces in unconstrained images and videos. In this paper, we describe the details of a deep learning pipeline for unconstrained face identification and verification which achieves state-of-the-art performance on several benchmark datasets. We propose a novel face detector, Deep Pyramid Single Shot Face Detector (DPSSD), which is fast and capable of detecting faces with large scale variations (especially tiny faces). We give design details of the various modules involved in automatic face recognition: face detection, landmark localization and alignment, and face identification/verification. We provide evaluation results of the proposed face detector on challenging unconstrained face detection datasets. Then, we present experimental results for IARPA Janus Benchmarks A, B and C (IJB-A, IJB-B, IJB-C), and the Janus Challenge Set 5 (CS5).

References in corpus (22)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Caffe: Convolutional Architecture for Fast Feature Embedding
• Learning Face Representation from Scratch
• Going Deeper with Convolutions
• Stacked Hourglass Networks for Human Pose Estimation
• Trunk-Branch Ensemble Convolutional Neural Networks for Video-based Face Recognition
• CosFace: Large Margin Cosine Loss for Deep Face Recognition
• MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
• Face Detection through Scale-Friendly Deep Convolutional Networks
• From Facial Parts Responses to Face Detection: A Deep Learning Approach
• DAGER: Deep Age, Gender and Emotion Recognition Using Convolutional Neural Network
• Face Search at Scale: 80 Million Gallery
• Do We Really Need to Collect Millions of Faces for Effective Face Recognition?
• Crystal Loss and Quality Pooling for Unconstrained Face Verification and Recognition
• Neural Aggregation Network for Video Face Recognition
• Deeply learned face representations are sparse, selective, and robust
• Face Detection with the Faster R-CNN
• S${}^3$FD: Single Shot Scale-invariant Face Detector
• Pose-Invariant 3D Face Alignment
• Face Alignment by Local Deep Descriptor Regression
• FacePoseNet: Making a Case for Landmark-Free Face Alignment
• A Jointly Learned Deep Architecture for Facial Attribute Analysis and Face Detection in the Wild