Interactive Neural Style Transfer with Artists
arXiv:2003.06659
Abstract
We present interactive painting processes in which a painter and various neural style transfer algorithms interact on a real canvas. Understanding what these algorithms' outputs achieve is then paramount to describe the creative agency in our interactive experiments. We gather a set of paired painting-pictures images and present a new evaluation methodology based on the predictivity of neural style transfer algorithms. We point some algorithms' instabilities and show that they can be used to enlarge the diversity and pleasing oddity of the images synthesized by the numerous existing neural style transfer algorithms. This diversity of images was perceived as a source of inspiration for human painters, portraying the machine as a computational catalyst.
References in corpus (8)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
- Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses
- Synthesizing Programs for Images using Reinforced Adversarial Learning
- Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting
- Neural Painters: A learned differentiable constraint for generating brushstroke paintings
- Wasserstein Style Transfer
- Dialog on a canvas with a machine