Situating the social issues of image generation models in the model life cycle: a sociotechnical approach

Abstract

The race to develop image generation models is intensifying, with a rapid increase in the number of text-to-image models available. This is coupled with growing public awareness of these technologies. Though other generative AI models--notably, large language models--have received recent critical attention for the social and other non-technical issues they raise, there has been relatively little comparable examination of image generation models. This paper reports on a novel, comprehensive categorization of the social issues associated with image generation models. At the intersection of machine learning and the social sciences, we report the results of a survey of the literature, identifying seven issue clusters arising from image generation models: data issues, intellectual property, bias, privacy, and the impacts on the informational, cultural, and natural environments. We situate these social issues in the model life cycle, to aid in considering where potential issues arise, and mitigation may be needed. We then compare these issue clusters with what has been reported for large language models. Ultimately, we argue that the risks posed by image generation models are comparable in severity to the risks posed by large language models, and that the social impact of image generation models must be urgently considered.

References in corpus (13)

• Learning Transferable Visual Models From Natural Language Supervision
• LAION-5B: An open large-scale dataset for training next generation image-text models
• LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs
• Imagen Video: High Definition Video Generation with Diffusion Models
• Make-A-Video: Text-to-Video Generation without Text-Video Data
• Power Hungry Processing: Watts Driving the Cost of AI Deployment?
• Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale
• The Creativity of Text-to-Image Generation
• Large-scale Text-to-Image Generation Models for Visual Artists' Creative Works
• Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
• What Does DALL-E 2 Know About Radiology?
• "An Adapt-or-Die Type of Situation": Perception, Adoption, and Use of Text-To-Image-Generation AI by Game Industry Professionals
• Exploiting Cultural Biases via Homoglyphs in Text-to-Image Synthesis

Cited by in corpus (1)

• Data Augmentation for Seizure Prediction with Generative Diffusion Model