Anisotropic Stroke Control for Multiple Artists Style Transfer

Abstract

Though significant progress has been made in artistic style transfer, semantic information is usually difficult to be preserved in a fine-grained locally consistent manner by most existing methods, especially when multiple artists styles are required to transfer within one single model. To circumvent this issue, we propose a Stroke Control Multi-Artist Style Transfer framework. On the one hand, we develop a multi-condition single-generator structure which first performs multi-artist style transfer. On the one hand, we design an Anisotropic Stroke Module (ASM) which realizes the dynamic adjustment of style-stroke between the non-trivial and the trivial regions. ASM endows the network with the ability of adaptive semantic-consistency among various styles. On the other hand, we present an novel Multi-Scale Projection Discriminator} to realize the texture-level conditional generation. In contrast to the single-scale conditional discriminator, our discriminator is able to capture multi-scale texture clue to effectively distinguish a wide range of artistic styles. Extensive experimental results well demonstrate the feasibility and effectiveness of our approach. Our framework can transform a photograph into different artistic style oil painting via only ONE single model. Furthermore, the results are with distinctive artistic style and retain the anisotropic semantic information. The code is already available on github: https://github.com/neuralchen/ASMAGAN.

arXiv commentACMMM2020

References in corpus (20)

• Adam: A Method for Stochastic Optimization
• Spectral Normalization for Generative Adversarial Networks
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Conditional Image Synthesis With Auxiliary Classifier GANs
• A Learned Representation For Artistic Style
• Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
• Wasserstein GAN
• Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
• Light Gated Recurrent Units for Speech Recognition
• cGANs with Projection Discriminator
• Universal Style Transfer via Feature Transforms
• Unsupervised Attention-guided Image to Image Translation
• Fast Patch-based Style Transfer of Arbitrary Style
• Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks
• Geometric GAN
• StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks
• Unsupervised Learning of Artistic Styles with Archetypal Style Analysis
• Arbitrary Style Transfer with Deep Feature Reshuffle
• Multi-Mapping Image-to-Image Translation with Central Biasing Normalization
• Instance-level Facial Attributes Transfer with Geometry-Aware Flow

Cited by in corpus (1)

• Image Translation via Fine-grained Knowledge Transfer