Patch-based Probabilistic Image Quality Assessment for Face Selection and Improved Video-based Face Recognition

Abstract

In video based face recognition, face images are typically captured over multiple frames in uncontrolled conditions, where head pose, illumination, shadowing, motion blur and focus change over the sequence. Additionally, inaccuracies in face localisation can also introduce scale and alignment variations. Using all face images, including images of poor quality, can actually degrade face recognition performance. While one solution it to use only the "best" subset of images, current face selection techniques are incapable of simultaneously handling all of the abovementioned issues. We propose an efficient patch-based face image quality assessment algorithm which quantifies the similarity of a face image to a probabilistic face model, representing an "ideal" face. Image characteristics that affect recognition are taken into account, including variations in geometric alignment (shift, rotation and scale), sharpness, head pose and cast shadows. Experiments on FERET and PIE datasets show that the proposed algorithm is able to identify images which are simultaneously the most frontal, aligned, sharp and well illuminated. Further experiments on a new video surveillance dataset (termed ChokePoint) show that the proposed method provides better face subsets than existing face selection techniques, leading to significant improvements in recognition accuracy.

References in corpus (2)

• Dynamic Amelioration of Resolution Mismatches for Local Feature Based Identity Inference
• Video Face Matching using Subset Selection and Clustering of Probabilistic Multi-Region Histograms

Cited by in corpus (18)

• Representation Learning by Rotating Your Faces
• Face Deidentification with Generative Deep Neural Networks
• Domain-Specific Face Synthesis for Video Face Recognition from a Single Sample Per Person
• Maximum A Posteriori Estimation of Distances Between Deep Features in Still-to-Video Face Recognition
• Face Image Quality Assessment: A Literature Survey
• Rank-based verification for long-term face tracking in crowded scenes
• Inducing Predictive Uncertainty Estimation for Face Recognition
• On Robust Face Recognition via Sparse Encoding: the Good, the Bad, and the Ugly
• SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distance
• Domain Adaptation with Soft-margin multiple feature-kernel learning beats Deep Learning for surveillance face recognition
• An Efficient Method for Face Quality Assessment on the Edge
• Deep Face Quality Assessment
• Attentive Deep Regression Networks for Real-Time Visual Face Tracking in Video Surveillance
• Densely Deformable Efficient Salient Object Detection Network
• Kernel Selection using Multiple Kernel Learning and Domain Adaptation in Reproducing Kernel Hilbert Space, for Face Recognition under Surveillance Scenario
• ClusterFace: Joint Clustering and Classification for Set-Based Face Recognition
• Intelligent Frame Selection as a Privacy-Friendlier Alternative to Face Recognition
• Deep Tiny Network for Recognition-Oriented Face Image Quality Assessment