Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks

Abstract

Recent studies on unsupervised image-to-image translation have made a remarkable progress by training a pair of generative adversarial networks with a cycle-consistent loss. However, such unsupervised methods may generate inferior results when the image resolution is high or the two image domains are of significant appearance differences, such as the translations between semantic layouts and natural images in the Cityscapes dataset. In this paper, we propose novel Stacked Cycle-Consistent Adversarial Networks (SCANs) by decomposing a single translation into multi-stage transformations, which not only boost the image translation quality but also enable higher resolution image-to-image translations in a coarse-to-fine manner. Moreover, to properly exploit the information from the previous stage, an adaptive fusion block is devised to learn a dynamic integration of the current stage's output and the previous stage's output. Experiments on multiple datasets demonstrate that our proposed approach can improve the translation quality compared with previous single-stage unsupervised methods.

arXiv commentTo appear in ECCV 2018

References in corpus (10)

• Conditional Generative Adversarial Nets
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• The Cityscapes Dataset for Semantic Urban Scene Understanding
• Unsupervised Image-to-Image Translation Networks
• Unsupervised Cross-Domain Image Generation
• Holistically-Nested Edge Detection
• DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
• Multi-View Image Generation from a Single-View
• Modular Generative Adversarial Networks