Semantically Multi-modal Image Synthesis
arXiv:2003.12697
Abstract
In this paper, we focus on semantically multi-modal image synthesis (SMIS) task, namely, generating multi-modal images at the semantic level. Previous work seeks to use multiple class-specific generators, constraining its usage in datasets with a small number of classes. We instead propose a novel Group Decreasing Network (GroupDNet) that leverages group convolutions in the generator and progressively decreases the group numbers of the convolutions in the decoder. Consequently, GroupDNet is armed with much more controllability on translating semantic labels to natural images and has plausible high-quality yields for datasets with many classes. Experiments on several challenging datasets demonstrate the superiority of GroupDNet on performing the SMIS task. We also show that GroupDNet is capable of performing a wide range of interesting synthesis applications. Codes and models are available at: https://github.com/Seanseattle/SMIS.
arXiv commentTo appear in CVPR 2020
References in corpus (18)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Auto-Encoding Variational Bayes
- Conditional Generative Adversarial Nets
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Spectral Normalization for Generative Adversarial Networks
- Self-Attention Generative Adversarial Networks
- Toward Multimodal Image-to-Image Translation
- A Learned Representation For Artistic Style
- Pose Guided Person Image Generation
- Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
- Non-Stationary Texture Synthesis by Adversarial Expansion
- Diversity-Sensitive Conditional Generative Adversarial Networks
- Learning Hierarchical Semantic Image Manipulation through Structured Representations
- Progressive Pose Attention Transfer for Person Image Generation
- Compatible and Diverse Fashion Image Inpainting
- Diverse Image Synthesis from Semantic Layouts via Conditional IMLE
- Program-Guided Image Manipulators