"It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models

Abstract

Prewriting is the process of discovering and developing ideas before a first draft, which requires divergent thinking and often implies unstructured strategies such as diagramming, outlining, free-writing, etc. Although large language models (LLMs) have been demonstrated to be useful for a variety of tasks including creative writing, little is known about how users would collaborate with LLMs to support prewriting. The preferred collaborative role and initiative of LLMs during such a creativity process is also unclear. To investigate human-LLM collaboration patterns and dynamics during prewriting, we conducted a three-session qualitative study with 15 participants in two creative tasks: story writing and slogan writing. The findings indicated that during collaborative prewriting, there appears to be a three-stage iterative Human-AI Co-creativity process that includes Ideation, Illumination, and Implementation stages. This collaborative process champions the human in a dominant role, in addition to mixed and shifting levels of initiative that exist between humans and LLMs. This research also reports on collaboration breakdowns that occur during this process, user perceptions of using existing LLMs during Human-AI Co-creativity, and discusses design implications to support this co-creativity process.

To appear at ACM CSCW 2024; Accepted to PACM HCI (CSCW); 25 pages, 2 figures

References in corpus (2)

• Perfection Not Required? Human-AI Partnerships in Code Translation
• Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries

Cited by in corpus (10)

• From Pen to Prompt: How Creative Writers Integrate AI into their Writing Practice
• Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
• Objection Overruled! Lay People can Distinguish Large Language Models from Lawyers, but still Favour Advice from an LLM
• VideoDiff: Human-AI Video Co-Creation with Alternatives
• Making the Write Connections: Linking Writing Support Tools with Writer's Needs
• One Does Not Simply Meme Alone: Evaluating Co-Creativity Between LLMs and Humans in the Generation of Humor
• Empowering Social Service with AI: Insights from a Participatory Design Study with Practitioners
• Should AI Mimic People? Understanding AI-Supported Writing Technology Among Black Users
• OSINT Clinic: Co-designing AI-Augmented Collaborative OSINT Investigations for Vulnerability Assessment
• StepWrite: Adaptive Planning for Speech-Driven Text Generation