Multi-Dataset Benchmarks for Masked Identification using Contrastive Representation Learning

Abstract

The COVID-19 pandemic has drastically changed accepted norms globally. Within the past year, masks have been used as a public health response to limit the spread of the virus. This sudden change has rendered many face recognition based access control, authentication and surveillance systems ineffective. Official documents such as passports, driving license and national identity cards are enrolled with fully uncovered face images. However, in the current global situation, face matching systems should be able to match these reference images with masked face images. As an example, in an airport or security checkpoint it is safer to match the unmasked image of the identifying document to the masked person rather than asking them to remove the mask. We find that current facial recognition techniques are not robust to this form of occlusion. To address this unique requirement presented due to the current circumstance, we propose a set of re-purposed datasets and a benchmark for researchers to use. We also propose a contrastive visual representation learning based pre-training workflow which is specialized to masked vs unmasked face matching. We ensure that our method learns robust features to differentiate people across varying data collection scenarios. We achieve this by training over many different datasets and validating our result by testing on various holdout datasets. The specialized weights trained by our method outperform standard face recognition features for masked to unmasked face matching. We believe the provided synthetic mask generating code, our novel training approach and the trained weights from the masked face models will help in adopting existing face recognition systems to operate in the current global environment. We open-source all contributions for broader use by the research community.

References in corpus (10)

• A Simple Framework for Contrastive Learning of Visual Representations
• Bootstrap your own latent: A new approach to self-supervised Learning
• Improved Baselines with Momentum Contrastive Learning
• Masked Face Recognition Dataset and Application
• Masked Face Recognition using ResNet-50
• Towards NIR-VIS Masked Face Recognition
• Masked Face Recognition Challenge: The WebFace260M Track Report
• Masked Face Recognition: Human vs. Machine
• Boosting Masked Face Recognition with Multi-Task ArcFace
• My Eyes Are Up Here: Promoting Focus on Uncovered Regions in Masked Face Recognition

Cited by in corpus (2)

• An Exploratory Study of Masked Face Recognition with Machine Learning Algorithms
• Does a Face Mask Protect my Privacy?: Deep Learning to Predict Protected Attributes from Masked Face Images