Generative Creativity: Adversarial Learning for Bionic Design

Abstract

Bionic design refers to an approach of generative creativity in which a target object (e.g. a floor lamp) is designed to contain features of biological source objects (e.g. flowers), resulting in creative biologically-inspired design. In this work, we attempt to model the process of shape-oriented bionic design as follows: given an input image of a design target object, the model generates images that 1) maintain shape features of the input design target image, 2) contain shape features of images from the specified biological source domain, 3) are plausible and diverse. We propose DesignGAN, a novel unsupervised deep generative approach to realising bionic design. Specifically, we employ a conditional Generative Adversarial Networks architecture with several designated losses (an adversarial loss, a regression loss, a cycle loss and a latent loss) that respectively constrict our model to meet the corresponding aforementioned requirements of bionic design modelling. We perform qualitative and quantitative experiments to evaluate our method, and demonstrate that our proposed approach successfully generates creative images of bionic design.

References in corpus (26)

• Adam: A Method for Stochastic Optimization
• Auto-Encoding Variational Bayes
• Conditional Generative Adversarial Nets
• TensorFlow: A system for large-scale machine learning
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Generative Adversarial Text to Image Synthesis
• Conditional Image Synthesis With Auxiliary Classifier GANs
• Conditional Image Generation with PixelCNN Decoders
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Pixel Recurrent Neural Networks
• Improved Techniques for Training GANs
• InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
• DRAW: A Recurrent Neural Network For Image Generation
• Energy-based Generative Adversarial Network
• A Learned Representation For Artistic Style
• Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
• A Neural Representation of Sketch Drawings
• Unsupervised Image-to-Image Translation Networks
• Unsupervised Cross-Domain Image Generation
• Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
• DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
• Multimodal Unsupervised Image-to-Image Translation
• Generative Visual Manipulation on the Natural Image Manifold
• Semantic Image Synthesis via Adversarial Learning
• Deep Painterly Harmonization