Attribute-Guided Face Generation Using Conditional CycleGAN

Abstract

We are interested in attribute-guided face generation: given a low-res face input image, an attribute vector that can be extracted from a high-res image (attribute image), our new method generates a high-res face image for the low-res input that satisfies the given attributes. To address this problem, we condition the CycleGAN and propose conditional CycleGAN, which is designed to 1) handle unpaired training data because the training low/high-res and high-res attribute images may not necessarily align with each other, and to 2) allow easy control of the appearance of the generated face via the input attributes. We demonstrate impressive results on the attribute-guided conditional CycleGAN, which can synthesize realistic face images with appearance easily controlled by user-supplied attributes (e.g., gender, makeup, hair color, eyeglasses). Using the attribute image as identity to produce the corresponding conditional vector and by incorporating a face verification network, the attribute-guided network becomes the identity-guided conditional CycleGAN which produces impressive and interesting results on identity transfer. We demonstrate three applications on identity-guided conditional CycleGAN: identity-preserving face superresolution, face swapping, and frontal face generation, which consistently show the advantage of our new method.

ECCV 2018

References in corpus (2)

• Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
• End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks

Cited by in corpus (17)

• ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributes
• Memorization Precedes Generation: Learning Unsupervised GANs with Memory Networks
• Conditional Image-to-Image Translation
• Transforming Spectrum and Prosody for Emotional Voice Conversion with Non-Parallel Training Data
• Optimal Transport driven CycleGAN for Unsupervised Learning in Inverse Problems
• A Utility-Preserving GAN for Face Obscuration
• Recent Progress of Face Image Synthesis
• Deepfake Video Forensics based on Transfer Learning
• Face Translation between Images and Videos using Identity-aware CycleGAN
• Learning Compositional Visual Concepts with Mutual Consistency
• A Multi-Domain Feature Learning Method for Visual Place Recognition
• PhysGAN: Generating Physical-World-Resilient Adversarial Examples for Autonomous Driving
• Modeling EEG data distribution with a Wasserstein Generative Adversarial Network to predict RSVP Events
• Pipeline Generative Adversarial Networks for Facial Images Generation with Multiple Attributes
• Visual Analogies between Atari Games for Studying Transfer Learning in RL
• Reconstructing faces from voices
• Dual Encoder-Decoder based Generative Adversarial Networks for Disentangled Facial Representation Learning