Face Expression Recognition and Analysis: The State of the Art

Abstract

The automatic recognition of facial expressions has been an active research topic since the early nineties. There have been several advances in the past few years in terms of face detection and tracking, feature extraction mechanisms and the techniques used for expression classification. This paper surveys some of the published work since 2001 till date. The paper presents a time-line view of the advances made in this field, the applications of automatic face expression recognizers, the characteristics of an ideal system, the databases that have been used and the advances made in terms of their standardization and a detailed summary of the state of the art. The paper also discusses facial parameterization using FACS Action Units (AUs) and MPEG-4 Facial Animation Parameters (FAPs) and the recent advances in face detection, tracking and feature extraction methods. Notes have also been presented on emotions, expressions and facial features, discussion on the six prototypic expressions and the recent studies on expression classifiers. The paper ends with a note on the challenges and the future work. This paper has been written in a tutorial style with the intention of helping students and researchers who are new to this field.

Cited by in corpus (17)

• Face Alignment Across Large Poses: A 3D Solution
• Face Alignment in Full Pose Range: A 3D Total Solution
• A Survey of Automatic Facial Micro-expression Analysis: Databases, Methods and Challenges
• DeXpression: Deep Convolutional Neural Network for Expression Recognition
• Convolutional Neural Networks for Facial Expression Recognition
• Towards Fast, Accurate and Stable 3D Dense Face Alignment
• Pose-Invariant 3D Face Alignment
• Pose-Invariant Face Alignment with a Single CNN
• A Survey of the Trends in Facial and Expression Recognition Databases and Methods
• Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN
• Face Synthesis with Landmark Points from Generative Adversarial Networks and Inverse Latent Space Mapping
• Do Facial Expressions Predict Ad Sharing? A Large-Scale Observational Study
• Facial movement synergies and Action Unit detection from distal wearable Electromyography and Computer Vision
• Alzheimer's Disease Diagnosis Based on Cognitive Methods in Virtual Environments and Emotions Analysis
• Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment
• A Multi-resolution Approach to Expression Recognition in the Wild
• Expression Recognition Analysis in the Wild