Recurrent Embedding Aggregation Network for Video Face Recognition
arXiv:1904.12019
Abstract
Recurrent networks have been successful in analyzing temporal data and have been widely used for video analysis. However, for video face recognition, where the base CNNs trained on large-scale data already provide discriminative features, using Long Short-Term Memory (LSTM), a popular recurrent network, for feature learning could lead to overfitting and degrade the performance instead. We propose a Recurrent Embedding Aggregation Network (REAN) for set to set face recognition. Compared with LSTM, REAN is robust against overfitting because it only learns how to aggregate the pre-trained embeddings rather than learning representations from scratch. Compared with quality-aware aggregation methods, REAN can take advantage of the context information to circumvent the noise introduced by redundant video frames. Empirical results on three public domain video face recognition datasets, IJB-S, YTF, and PaSC show that the proposed REAN significantly outperforms naive CNN-LSTM structure and quality-aware aggregation methods.
References in corpus (8)
- In Defense of the Triplet Loss for Person Re-Identification
- Spatial-Temporal Recurrent Neural Network for Emotion Recognition
- Trunk-Branch Ensemble Convolutional Neural Networks for Video-based Face Recognition
- A Riemannian Network for SPD Matrix Learning
- Multicolumn Networks for Face Recognition
- Crystal Loss and Quality Pooling for Unconstrained Face Verification and Recognition
- Building Deep Networks on Grassmann Manifolds
- Video Face Recognition: Component-wise Feature Aggregation Network (C-FAN)