Multi-Mapping Image-to-Image Translation with Central Biasing Normalization

Abstract

Recent advances in image-to-image translation have seen a rise in approaches generating diverse images through a single network. To indicate the target domain for a one-to-many mapping, the latent code is injected into the generator network. However, we found that the injection method leads to mode collapse because of normalization strategies. Existing normalization strategies might either cause the inconsistency of feature distribution or eliminate the effect of the latent code. To solve these problems, we propose the consistency within diversity criteria for designing the multi-mapping model. Based on the criteria, we propose central biasing normalization to inject the latent code information. Experiments show that our method can improve the quality and diversity of existing image-to-image translation models, such as StarGAN, BicycleGAN, and pix2pix.

References in corpus (14)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Auto-Encoding Variational Bayes
• Conditional Generative Adversarial Nets
• Generative Adversarial Networks: An Overview
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Generative Adversarial Text to Image Synthesis
• Conditional Image Synthesis With Auxiliary Classifier GANs
• NIPS 2016 Tutorial: Generative Adversarial Networks
• Toward Multimodal Image-to-Image Translation
• Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
• Adversarially Learned Inference
• Unsupervised Attention-guided Image to Image Translation

Cited by in corpus (4)

• Anisotropic Stroke Control for Multiple Artists Style Transfer
• SingleGAN: Image-to-Image Translation by a Single-Generator Network using Multiple Generative Adversarial Learning
• Unified cross-modality feature disentangler for unsupervised multi-domain MRI abdomen organs segmentation
• Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networks