Generative Art Using Neural Visual Grammars and Dual Encoders
arXiv:2105.00162
Abstract
Whilst there are perhaps only a few scientific methods, there seem to be almost as many artistic methods as there are artists. Artistic processes appear to inhabit the highest order of open-endedness. To begin to understand some of the processes of art making it is helpful to try to automate them even partially. In this paper, a novel algorithm for producing generative art is described which allows a user to input a text string, and which in a creative response to this string, outputs an image which interprets that string. It does so by evolving images using a hierarchical neural Lindenmeyer system, and evaluating these images along the way using an image text dual encoder trained on billions of images and their associated text from the internet. In doing so we have access to and control over an instance of an artistic process, allowing analysis of which aspects of the artistic process become the task of the algorithm, and which elements remain the responsibility of the artist.
References in corpus (9)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Learning Transferable Visual Models From Natural Language Supervision
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
- Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
- High-Performance Large-Scale Image Recognition Without Normalization
- CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms
- Data and its (dis)contents: A survey of dataset development and use in machine learning research
- From Language Games to Drawing Games