Level generation and style enhancement -- deep learning for game development overview
arXiv:2107.07397
Abstract
We present practical approaches of using deep learning to create and enhance level maps and textures for video games -- desktop, mobile, and web. We aim to present new possibilities for game developers and level artists. The task of designing levels and filling them with details is challenging. It is both time-consuming and takes effort to make levels rich, complex, and with a feeling of being natural. Fortunately, recent progress in deep learning provides new tools to accompany level designers and visual artists. Moreover, they offer a way to generate infinite worlds for game replayability and adjust educational games to players' needs. We present seven approaches to create level maps, each using statistical methods, machine learning, or deep learning. In particular, we include: - Generative Adversarial Networks for creating new images from existing examples (e.g. ProGAN). - Super-resolution techniques for upscaling images while preserving crisp detail (e.g. ESRGAN). - Neural style transfer for changing visual themes. - Image translation - turning semantic maps into images (e.g. GauGAN). - Semantic segmentation for turning images into semantic masks (e.g. U-Net). - Unsupervised semantic segmentation for extracting semantic features (e.g. Tile2Vec). - Texture synthesis - creating large patterns based on a smaller sample (e.g. InGAN).
arXiv comment16 pages, 10 figures, submitted to the 52nd International Simulation and Gaming Association (ISAGA) Conference 2021
References in corpus (16)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Language Models are Few-Shot Learners
- NIPS 2016 Tutorial: Generative Adversarial Networks
- Zero-Shot Text-to-Image Generation
- Dota 2 with Large Scale Deep Reinforcement Learning
- Human-level performance in first-person multiplayer games with population-based deep reinforcement learning
- GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentation
- Learning What and Where to Draw
- Non-Stationary Texture Synthesis by Adversarial Expansion
- Deep Learning for Procedural Content Generation
- Towards the Automatic Anime Characters Creation with Generative Adversarial Networks
- TensorFlow.js: Machine Learning for the Web and Beyond
- TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network
- Toward Game Level Generation from Gameplay Videos