ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows

Abstract

Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not aware of the content leak phenomenon that the image content may corrupt after several rounds of stylization process. In this paper, we propose ArtFlow to prevent content leak during universal style transfer. ArtFlow consists of reversible neural flows and an unbiased feature transfer module. It supports both forward and backward inferences and operates in a projection-transfer-reversion scheme. The forward inference projects input images into deep features, while the backward inference remaps deep features back to input images in a lossless and unbiased way. Extensive experiments demonstrate that ArtFlow achieves comparable performance to state-of-the-art style transfer methods while avoiding content leak.

arXiv commentCVPR 2021 Accepted

References in corpus (25)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Instance Normalization: The Missing Ingredient for Fast Stylization
• NICE: Non-linear Independent Components Estimation
• Training Generative Adversarial Networks with Limited Data
• A Learned Representation For Artistic Style
• Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
• Fast Patch-based Style Transfer of Arbitrary Style
• Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
• Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses
• Preserving Color in Neural Artistic Style Transfer
• Multi-style Generative Network for Real-time Transfer
• Learning Linear Transformations for Fast Arbitrary Style Transfer
• Demystifying Neural Style Transfer
• StyleBank: An Explicit Representation for Neural Image Style Transfer
• CREST: Convolutional Residual Learning for Visual Tracking
• Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
• Stylizing Face Images via Multiple Exemplars
• Learning to Hallucinate Face Images via Component Generation and Enhancement
• Arbitrary Style Transfer with Deep Feature Reshuffle
• Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning
• A Closed-form Solution to Universal Style Transfer
• Geometric Style Transfer
• Neural Stereoscopic Image Style Transfer