AU-Guided Unsupervised Domain Adaptive Facial Expression Recognition

Abstract

The domain diversities including inconsistent annotation and varied image collection conditions inevitably exist among different facial expression recognition (FER) datasets, which pose an evident challenge for adapting the FER model trained on one dataset to another one. Recent works mainly focus on domain-invariant deep feature learning with adversarial learning mechanism, ignoring the sibling facial action unit (AU) detection task which has obtained great progress. Considering AUs objectively determine facial expressions, this paper proposes an AU-guided unsupervised Domain Adaptive FER (AdaFER) framework to relieve the annotation bias between different FER datasets. In AdaFER, we first leverage an advanced model for AU detection on both source and target domain. Then, we compare the AU results to perform AU-guided annotating, i.e., target faces that own the same AUs with source faces would inherit the labels from source domain. Meanwhile, to achieve domain-invariant compact features, we utilize an AU-guided triplet training which randomly collects anchor-positive-negative triplets on both domains with AUs. We conduct extensive experiments on several popular benchmarks and show that AdaFER achieves state-of-the-art results on all these benchmarks.

arXiv commentThis is a very simple CD-FER framework

References in corpus (12)

• AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
• Deep Facial Expression Recognition: A Survey
• Conditional Adversarial Domain Adaptation
• Going Deeper in Facial Expression Recognition using Deep Neural Networks
• Deep Learning using Linear Support Vector Machines
• RetinaFace: Single-stage Dense Face Localisation in the Wild
• Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks
• A Deeper Look at Facial Expression Dataset Bias
• Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition
• Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition
• Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
• Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning