Efficient Facial Representations for Age, Gender and Identity Recognition in Organizing Photo Albums using Multi-output CNN

Abstract

This paper is focused on the automatic extraction of persons and their attributes (gender, year of born) from album of photos and videos. We propose the two-stage approach, in which, firstly, the convolutional neural network simultaneously predicts age/gender from all photos and additionally extracts facial representations suitable for face identification. We modified the MobileNet, which is preliminarily trained to perform face recognition, in order to additionally recognize age and gender. In the second stage of our approach, extracted faces are grouped using hierarchical agglomerative clustering techniques. The born year and gender of a person in each cluster are estimated using aggregation of predictions for individual photos. We experimentally demonstrated that our facial clustering quality is competitive with the state-of-the-art neural networks, though our implementation is much computationally cheaper. Moreover, our approach is characterized by more accurate video-based age/gender recognition when compared to the publicly available models.

arXiv comment19 pages, 2 figures, 8 tables

References in corpus (14)

• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
• Wide Residual Networks
• Deep Learning Face Representation by Joint Identification-Verification
• Additive Margin Softmax for Face Verification
• DeepID3: Face Recognition with Very Deep Neural Networks
• CNN Features off-the-shelf: an Astounding Baseline for Recognition
• SphereFace: Deep Hypersphere Embedding for Face Recognition
• Learnable pooling with Context Gating for video classification
• Targeting Ultimate Accuracy: Face Recognition via Deep Embedding
• One-shot Face Recognition by Promoting Underrepresented Classes
• Face Clustering: Representation and Pairwise Constraints
• Maximum A Posteriori Estimation of Distances Between Deep Features in Still-to-Video Face Recognition
• Merge or Not? Learning to Group Faces via Imitation Learning

Cited by in corpus (6)

• Facial expression and attributes recognition based on multi-task learning of lightweight neural networks
• Preferences Prediction using a Gallery of Mobile Device based on Scene Recognition and Object Detection
• Does a Face Mask Protect my Privacy?: Deep Learning to Predict Protected Attributes from Masked Face Images
• Event Recognition with Automatic Album Detection based on Sequential Processing, Neural Attention and Image Captioning
• Automatic Face Understanding: Recognizing Families in Photos
• Gender domain adaptation for automatic speech recognition task