Unpaired Image-to-Image Translation using Adversarial Consistency Loss
arXiv:2003.04858
Abstract
Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However, due to the strict pixel-level constraint, it cannot perform geometric changes, remove large objects, or ignore irrelevant texture. In this paper, we propose a novel adversarial-consistency loss for image-to-image translation. This loss does not require the translated image to be translated back to be a specific source image but can encourage the translated images to retain important features of the source images and overcome the drawbacks of cycle-consistency loss noted above. Our method achieves state-of-the-art results on three challenging tasks: glasses removal, male-to-female translation, and selfie-to-anime translation.
References in corpus (8)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Toward Multimodal Image-to-Image Translation
- Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
- U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
- Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
- Unsupervised Attention-guided Image to Image Translation
- Variational Approaches for Auto-Encoding Generative Adversarial Networks
- DRIT++: Diverse Image-to-Image Translation via Disentangled Representations