Stable diffusion models reveal a persisting human and AI gap in visual creativity

Abstract

While recent research suggests Large Language Models match human creative performance in divergent thinking tasks, visual creativity remains underexplored. This study compared image generation in human participants (Visual Artists and Non Artists) and using an image generation AI model (two prompting conditions with varying human input: high for Human Inspired, low for Self Guided). Human raters (N=255) and GPT4o evaluated the creativity of the resulting images. We found a clear creativity gradient, with Visual Artists being the most creative, followed by Non Artists, then Human Inspired generative AI, and finally Self Guided generative AI. Increased human guidance strongly improved GenAI's creative output, bringing its productions close to those of Non Artists. Notably, human and AI raters also showed vastly different creativity judgment patterns. These results suggest that, in contrast to language centered tasks, GenAI models may face unique challenges in visual domains, where creativity depends on perceptual nuance and contextual sensitivity, distinctly human capacities that may not be readily transferable from language models.

References in corpus (6)

• NIMA: Neural Image Assessment
• Art and the science of generative AI: A deeper dive
• Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativity
• A Taxonomy of Prompt Modifiers for Text-To-Image Generation
• A Prompt Log Analysis of Text-to-Image Generation Systems
• Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models