Multi-Channel Attention Selection GANs for Guided Image-to-Image Translation
arXiv:2002.01048
Abstract
We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic guidance. The proposed SelectionGAN explicitly utilizes the semantic guidance information and consists of two stages. In the first stage, the input image and the conditional semantic guidance are fed into a cycled semantic-guided generation network to produce initial coarse results. In the second stage, we refine the initial results by using the proposed multi-scale spatial pooling & channel selection module and the multi-channel attention selection module. Moreover, uncertainty maps automatically learned from attention maps are used to guide the pixel loss for better network optimization. Exhaustive experiments on four challenging guided image-to-image translation tasks (face, hand, body, and street view) demonstrate that our SelectionGAN is able to generate significantly better results than the state-of-the-art methods. Meanwhile, the proposed framework and modules are unified solutions and can be applied to solve other generation tasks such as semantic image synthesis. The code is available at https://github.com/Ha0Tang/SelectionGAN.
Accepted to TPAMI, an extended version of a paper published in CVPR2019. arXiv admin note: substantial text overlap with arXiv:1904.06807
References in corpus (6)
- Conditional Generative Adversarial Nets
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
- AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks
- Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation
- Asymmetric GANs for Image-to-Image Translation
Cited by in corpus (5)
- Deep Image Spatial Transformation for Person Image Generation
- AReLU: Attention-based Rectified Linear Unit
- Improving ClusterGAN Using Self-Augmented Information Maximization of Disentangling Latent Spaces
- Fine-grained MRI Reconstruction using Attentive Selection Generative Adversarial Networks
- Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance