Distribution Aligned Multimodal and Multi-Domain Image Stylization
arXiv:2006.01431
Abstract
Multimodal and multi-domain stylization are two important problems in the field of image style transfer. Currently, there are few methods that can perform both multimodal and multi-domain stylization simultaneously. In this paper, we propose a unified framework for multimodal and multi-domain style transfer with the support of both exemplar-based reference and randomly sampled guidance. The key component of our method is a novel style distribution alignment module that eliminates the explicit distribution gaps between various style domains and reduces the risk of mode collapse. The multimodal diversity is ensured by either guidance from multiple images or random style code, while the multi-domain controllability is directly achieved by using a domain label. We validate our proposed framework on painting style transfer with a variety of different artistic styles and genres. Qualitative and quantitative comparisons with state-of-the-art methods demonstrate that our method can generate high-quality results of multi-domain styles and multimodal instances with reference style guidance or random sampled style.
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- Conditional Generative Adversarial Nets
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Conditional Image Synthesis With Auxiliary Classifier GANs
- DRIT++: Diverse Image-to-Image Translation via Disentangled Representations
- A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation
- Learning Linear Transformations for Fast Arbitrary Style Transfer
- StyleGAN2 Distillation for Feed-forward Image Manipulation