A Neural Representation of Sketch Drawings

Abstract

We present sketch-rnn, a recurrent neural network (RNN) able to construct stroke-based drawings of common objects. The model is trained on thousands of crude human-drawn images representing hundreds of classes. We outline a framework for conditional and unconditional sketch generation, and describe new robust training methods for generating coherent sketch drawings in a vector format.

Cited by in corpus (69)

• Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creators
• Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
• Super-resolution image display using diffractive decoders
• Content and Style Aware Generation of Text-line Images for Handwriting Recognition
• SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design
• ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis
• Unsupervised Doodling and Painting with Improved SPIRAL
• Cross-Modal Hierarchical Modelling for Fine-Grained Sketch Based Image Retrieval
• Creative Sketch Generation
• DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning
• Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation
• Learning abstract structure for drawing by efficient motor program induction
• Im2Oil: Stroke-Based Oil Painting Rendering with Linearly Controllable Fineness Via Adaptive Sampling
• Deep hybrid model with satellite imagery: how to combine demand modeling and computer vision for behavior analysis?
• Model-based Reinforcement Learning for Predictions and Control for Limit Order Books
• More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrieval
• From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent
• Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders
• StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval
• Machine learning based co-creative design framework
• Neuralogram: A Deep Neural Network Based Representation for Audio Signals
• Adaptive Parameterization for Neural Dialogue Generation
• The DIDI dataset: Digital Ink Diagram data
• Interactive Neural Painting
• PaintBot: A Reinforcement Learning Approach for Natural Media Painting
• Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestalt
• Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting
• Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications
• Photo-Sketching: Inferring Contour Drawings from Images
• Teaching GANs to Sketch in Vector Format
• PSDoodle: Fast App Screen Search via Partial Screen Doodle
• NeuNetS: An Automated Synthesis Engine for Neural Network Design
• SketchyCOCO: Image Generation from Freehand Scene Sketches
• BézierSketch: A generative model for scalable vector sketches
• Mechanisms of Artistic Creativity in Deep Learning Neural Networks
• Session-based Sequential Skip Prediction via Recurrent Neural Networks
• Learning Neurosymbolic Generative Models via Program Synthesis
• Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models
• On Predictive Information in RNNs
• A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks
• Trick or TReAT: Thematic Reinforcement for Artistic Typography
• Coevo: a collaborative design platform with artificial agents
• Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks
• Towards Movement Generation with Audio Features
• Deep Self-Supervised Representation Learning for Free-Hand Sketch
• Geometric Losses for Distributional Learning
• Contextualizing Enhances Gradient Based Meta Learning
• Adversarial recovery of agent rewards from latent spaces of the limit order book
• On Learning Semantic Representations for Million-Scale Free-Hand Sketches
• Text-to-Image Generation Grounded by Fine-Grained User Attention
• Cloud2Curve: Generation and Vectorization of Parametric Sketches
• VMAV-C: A Deep Attention-based Reinforcement Learning Algorithm for Model-based Control
• Deep Learning for Identifying Potential Conceptual Shifts for Co-creative Drawing
• Humans learn too: Better Human-AI Interaction using Optimized Human Inputs
• Sketch Generation with Drawing Process Guided by Vector Flow and Grayscale
• CIZSL++: Creativity Inspired Generative Zero-Shot Learning
• Spatiotemporal Data Fusion for Precipitation Nowcasting
• Generating the support with extreme value losses
• Dual Reinforcement-Based Specification Generation for Image De-Rendering
• Fine-Grained Instance-Level Sketch-Based Video Retrieval
• LiveSketch: Query Perturbations for Guided Sketch-based Visual Search
• Processsing Simple Geometric Attributes with Autoencoders
• Learning to See via Epiretinal Implant Stimulation in silico with Model-Based Deep Reinforcement Learning
• Do Time Constraints Re-Prioritize Attention to Shapes During Visual Photo Inspection?
• SketchTransfer: A Challenging New Task for Exploring Detail-Invariance and the Abstractions Learned by Deep Networks
• Shallow Art: Art Extension Through Simple Machine Learning
• Online trajectory recovery from offline handwritten Japanese kanji characters
• Sketch-Inspector: a Deep Mixture Model for High-Quality Sketch Generation of Cats
• CanvasVAE: Learning to Generate Vector Graphic Documents