Learning Residual Images for Face Attribute Manipulation
arXiv:1612.05363
Abstract
Face attributes are interesting due to their detailed description of human faces. Unlike prior researches working on attribute prediction, we address an inverse and more challenging problem called face attribute manipulation which aims at modifying a face image according to a given attribute value. Instead of manipulating the whole image, we propose to learn the corresponding residual image defined as the difference between images before and after the manipulation. In this way, the manipulation can be operated efficiently with modest pixel modification. The framework of our approach is based on the Generative Adversarial Network. It consists of two image transformation networks and a discriminative network. The transformation networks are responsible for the attribute manipulation and its dual operation and the discriminative network is used to distinguish the generated images from real images. We also apply dual learning to allow transformation networks to learn from each other. Experiments show that residual images can be effectively learned and used for attribute manipulations. The generated images remain most of the details in attribute-irrelevant areas.
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
- InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution
- DRAW: A Recurrent Neural Network For Image Generation
- Autoencoding beyond pixels using a learned similarity metric
- Dual Learning for Machine Translation
- A note on the evaluation of generative models
- Deep Identity-aware Transfer of Facial Attributes
Cited by in corpus (6)
- Achieving Human Parity on Automatic Chinese to English News Translation
- An Introduction to Image Synthesis with Generative Adversarial Nets
- Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis
- DCAN: Dual Channel-wise Alignment Networks for Unsupervised Scene Adaptation
- ACE: Adapting to Changing Environments for Semantic Segmentation
- CounteRGAN: Generating Realistic Counterfactuals with Residual Generative Adversarial Nets