Expression Conditional GAN for Facial Expression-to-Expression Translation
arXiv:1905.05416
Abstract
In this paper, we focus on the facial expression translation task and propose a novel Expression Conditional GAN (ECGAN) which can learn the mapping from one image domain to another one based on an additional expression attribute. The proposed ECGAN is a generic framework and is applicable to different expression generation tasks where specific facial expression can be easily controlled by the conditional attribute label. Besides, we introduce a novel face mask loss to reduce the influence of background changing. Moreover, we propose an entire framework for facial expression generation and recognition in the wild, which consists of two modules, i.e., generation and recognition. Finally, we evaluate our framework on several public face datasets in which the subjects have different races, illumination, occlusion, pose, color, content and background conditions. Even though these datasets are very diverse, both the qualitative and quantitative results demonstrate that our approach is able to generate facial expressions accurately and robustly.
5 pages, 5 figures, accepted to ICIP 2019
References in corpus (7)
- Conditional Generative Adversarial Nets
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Generative Adversarial Text to Image Synthesis
- Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
- Invertible Conditional GANs for image editing
- Unsupervised Attention-guided Image to Image Translation
- Learning What and Where to Draw