Feature Pyramid Network for Multi-task Affective Analysis
arXiv:2107.03670
Abstract
Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. We propose a novel model named feature pyramid networks for multi-task affect analysis. The hierarchical features are extracted to predict three labels and we apply a teacher-student training strategy to learn from pretrained single-task models. Extensive experiment results demonstrate the proposed model outperforms other models. This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA.
arXiv comment5 pages, 3 figures
References in corpus (8)
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
- Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond
- Face Behavior a la carte: Expressions, Affect and Action Units in a Single Network
- Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Study
- Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework
- Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFace
- Generic 3D Representation via Pose Estimation and Matching