RetinaFace: Single-stage Dense Face Localisation in the Wild
arXiv:1905.00641
Abstract
Though tremendous strides have been made in uncontrolled face detection, accurate and efficient face localisation in the wild remains an open challenge. This paper presents a robust single-stage face detector, named RetinaFace, which performs pixel-wise face localisation on various scales of faces by taking advantages of joint extra-supervised and self-supervised multi-task learning. Specifically, We make contributions in the following five aspects: (1) We manually annotate five facial landmarks on the WIDER FACE dataset and observe significant improvement in hard face detection with the assistance of this extra supervision signal. (2) We further add a self-supervised mesh decoder branch for predicting a pixel-wise 3D shape face information in parallel with the existing supervised branches. (3) On the WIDER FACE hard test set, RetinaFace outperforms the state of the art average precision (AP) by 1.1% (achieving AP equal to 91.4%). (4) On the IJB-C test set, RetinaFace enables state of the art methods (ArcFace) to improve their results in face verification (TAR=89.59% for FAR=1e-6). (5) By employing light-weight backbone networks, RetinaFace can run real-time on a single CPU core for a VGA-resolution image. Extra annotations and code have been made available at: https://github.com/deepinsight/insightface/tree/master/RetinaFace.
References in corpus (14)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- YOLO9000: Better, Faster, Stronger
- On Learning 3D Face Morphable Model from In-the-wild Images
- Face Attention Network: An Effective Face Detector for the Occluded Faces
- TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
- Face Detection through Scale-Friendly Deep Convolutional Networks
- Detecting Faces Using Region-based Fully Convolutional Networks
- Face Detection Using Improved Faster RCNN
- Learning Better Features for Face Detection with Feature Fusion and Segmentation Supervision
- Improved Selective Refinement Network for Face Detection
- WIDER Face and Pedestrian Challenge 2018: Methods and Results
- Feature Agglomeration Networks for Single Stage Face Detection
- Robust and High Performance Face Detector
Cited by in corpus (71)
- R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network
- DeepFaceLab: Integrated, flexible and extensible face-swapping framework
- Deep Polynomial Neural Networks
- Sample and Computation Redistribution for Efficient Face Detection
- TinaFace: Strong but Simple Baseline for Face Detection
- Deepfake Detection using Spatiotemporal Convolutional Networks
- MIDV-2020: A Comprehensive Benchmark Dataset for Identity Document Analysis
- Gendered Differences in Face Recognition Accuracy Explained by Hairstyles, Makeup, and Facial Morphology
- Going Deeper Into Face Detection: A Survey
- Large image datasets: A pyrrhic win for computer vision?
- YOLO5Face: Why Reinventing a Face Detector
- DFME: A New Benchmark for Dynamic Facial Micro-expression Recognition
- Achieving Better Kinship Recognition Through Better Baseline
- CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations
- LOTR: Face Landmark Localization Using Localization Transformer
- RefineFace: Refinement Neural Network for High Performance Face Detection
- CenterFace: Joint Face Detection and Alignment Using Face as Point
- Multi-attentional Deepfake Detection
- FaceX-Zoo: A PyTorch Toolbox for Face Recognition
- ASFD: Automatic and Scalable Face Detector
- Light Can Hack Your Face! Black-box Backdoor Attack on Face Recognition Systems
- On Learning Disentangled Representations for Gait Recognition
- CN-CELEB: a challenging Chinese speaker recognition dataset
- MaskFace: multi-task face and landmark detector
- Investigating the Impact of Pre-processing and Prediction Aggregation on the DeepFake Detection Task
- HIH: Towards More Accurate Face Alignment via Heatmap in Heatmap
- Deep Face Recognition Model Compression via Knowledge Transfer and Distillation
- Face Detection with Feature Pyramids and Landmarks
- Automated Anonymisation of Visual and Audio Data in Classroom Studies
- SMOT: Single-Shot Multi Object Tracking
- CN-Celeb: multi-genre speaker recognition
- AirFace: Lightweight and Efficient Model for Face Recognition
- Cascaded Human-Object Interaction Recognition
- Emotion Recognition for In-the-wild Videos
- LDC-Net: A Unified Framework for Localization, Detection and Counting in Dense Crowds
- VarGFaceNet: An Efficient Variable Group Convolutional Neural Network for Lightweight Face Recognition
- T: Multi-Modal Continuous Valence-Arousal Estimation in the Wild
- Prototype Memory for Large-scale Face Representation Learning
- Fast and Reliable Probabilistic Face Embeddings in the Wild
- TwinLiteNet: An Efficient and Lightweight Model for Driveable Area and Lane Segmentation in Self-Driving Cars
- An Effective Deep Network for Head Pose Estimation without Keypoints
- AU-Guided Unsupervised Domain Adaptive Facial Expression Recognition
- Discriminability Distillation in Group Representation Learning
- Built Year Prediction from Buddha Face with Heterogeneous Labels
- Drone LAMS: A Drone-based Face Detection Dataset with Large Angles and Many Scenarios
- A 3D GAN for Improved Large-pose Facial Recognition
- An Efficient Method for Face Quality Assessment on the Edge
- Everyone's Privacy Matters! An Analysis of Privacy Leakage from Real-World Facial Images on Twitter and Associated User Behaviors
- Advances and Challenges in Deep Lip Reading
- Cognitive networks identify the content of English and Italian popular posts about COVID-19 vaccines: Anticipation, logistics, conspiracy and loss of trust
- Disentangle Your Dense Object Detector
- Sub-pixel face landmarks using heatmaps and a bag of tricks
- More Information Supervised Probabilistic Deep Face Embedding Learning
- On Recognizing Occluded Faces in the Wild
- 3D High-Fidelity Mask Face Presentation Attack Detection Challenge
- When Face Recognition Meets Occlusion: A New Benchmark
- CASSOD-Net: Cascaded and Separable Structures of Dilated Convolution for Embedded Vision Systems and Applications
- HLT-NUS Submission for NIST 2019 Multimedia Speaker Recognition Evaluation
- Determination of the most representative descriptor among a set of feature vectors for the same object
- Audio-visual Speaker Recognition with a Cross-modal Discriminative Network
- (Un)Masked COVID-19 Trends from Social Media
- Face-NMS: A Core-set Selection Approach for Efficient Face Recognition
- DeepActsNet: Spatial and Motion features from Face, Hands, and Body Combined with Convolutional and Graph Networks for Improved Action Recognition
- Towards Flops-constrained Face Recognition
- Balanced Masked and Standard Face Recognition
- Deep Tiny Network for Recognition-Oriented Face Image Quality Assessment
- STC speaker recognition systems for the NIST SRE 2021
- Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset
- TAL EmotioNet Challenge 2020 Rethinking the Model Chosen Problem in Multi-Task Learning
- Harnessing Geometric Constraints from Emotion Labels to improve Face Verification
- Does Face Recognition Error Echo Gender Classification Error?