Geometry Guided Adversarial Facial Expression Synthesis

Abstract

Facial expression synthesis has drawn much attention in the field of computer graphics and pattern recognition. It has been widely used in face animation and recognition. However, it is still challenging due to the high-level semantic presence of large and non-linear face geometry variations. This paper proposes a Geometry-Guided Generative Adversarial Network (G2-GAN) for photo-realistic and identity-preserving facial expression synthesis. We employ facial geometry (fiducial points) as a controllable condition to guide facial texture synthesis with specific expression. A pair of generative adversarial subnetworks are jointly trained towards opposite tasks: expression removal and expression synthesis. The paired networks form a mapping cycle between neutral expression and arbitrary expressions, which also facilitate other applications such as face transfer and expression invariant face recognition. Experimental results show that our method can generate compelling perceptual results on various facial expression synthesis databases. An expression invariant face recognition experiment is also performed to further show the advantages of our proposed method.

Cited by in corpus (8)

• Deep Facial Expression Recognition: A Survey
• Cross-view image synthesis using geometry-guided conditional GANs
• Adversarial Training in Affective Computing and Sentiment Analysis: Recent Advances and Perspectives
• All-In-One: Facial Expression Transfer, Editing and Recognition Using A Single Network
• GestureGAN for Hand Gesture-to-Gesture Translation in the Wild
• A Personalized Affective Memory Neural Model for Improving Emotion Recognition
• The Many Moods of Emotion
• Total Generate: Cycle in Cycle Generative Adversarial Networks for Generating Human Faces, Hands, Bodies, and Natural Scenes