A Deeper Look at Facial Expression Dataset Bias

Abstract

Datasets play an important role in the progress of facial expression recognition algorithms, but they may suffer from obvious biases caused by different cultures and collection conditions. To look deeper into this bias, we first conduct comprehensive experiments on dataset recognition and crossdataset generalization tasks, and for the first time explore the intrinsic causes of the dataset discrepancy. The results quantitatively verify that current datasets have a strong buildin bias and corresponding analyses indicate that the conditional probability distributions between source and target datasets are different. However, previous researches are mainly based on shallow features with limited discriminative ability under the assumption that the conditional distribution remains unchanged across domains. To address these issues, we further propose a novel deep Emotion-Conditional Adaption Network (ECAN) to learn domain-invariant and discriminative feature representations, which can match both the marginal and the conditional distributions across domains simultaneously. In addition, the largely ignored expression class distribution bias is also addressed by a learnable re-weighting parameter, so that the training and testing domains can share similar class distribution. Extensive cross-database experiments on both lab-controlled datasets (CK+, JAFFE, MMI and Oulu-CASIA) and real-world databases (AffectNet, FER2013, RAF-DB 2.0 and SFEW 2.0) demonstrate that our ECAN can yield competitive performances across various facial expression transfer tasks and outperform the state-of-theart methods.

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Caffe: Convolutional Architecture for Fast Feature Embedding
• How transferable are features in deep neural networks?
• Learning Transferable Features with Deep Adaptation Networks
• AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
• Going Deeper in Facial Expression Recognition using Deep Neural Networks
• Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks
• Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition
• Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields

Cited by in corpus (10)

• Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
• Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teacher
• Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning
• Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
• AU-Guided Unsupervised Domain Adaptive Facial Expression Recognition
• Adversarial Graph Representation Adaptation for Cross-Domain Facial Expression Recognition
• Automated Deepfake Detection
• Omni-supervised Facial Expression Recognition via Distilled Data
• Causal-Ex: Causal Graph-based Micro and Macro Expression Spotting
• Point Adversarial Self Mining: A Simple Method for Facial Expression Recognition