Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
arXiv:2504.12488 · doi:10.1145/3757566
Abstract
As generative AI tools like ChatGPT become integral to everyday writing, critical questions arise about how to preserve writers' sense of agency and ownership when using these tools. Yet, a systematic understanding of how AI assistance affects different aspects of the writing process - and how this shapes writers' agency - remains underexplored. To address this gap, we conducted a systematic review of 109 HCI papers using the PRISMA approach. From this literature, we identify four overarching design strategies for AI writing support: structured guidance, guided exploration, active co-writing, and critical feedback - mapped across the four key cognitive processes in writing: planning, translating, reviewing, and monitoring. We complement this analysis with interviews of 15 writers across diverse domains. Our findings reveal that writers' desired levels of AI intervention vary across the writing process: content-focused writers (e.g., academics) prioritize ownership during planning, while form-focused writers (e.g., creatives) value control over translating and reviewing. Writers' preferences are also shaped by contextual goals, values, and notions of originality and authorship. By examining when ownership matters, what writers want to own, and how AI interactions shape agency, we surface both alignment and gaps between research and user needs. Our findings offer actionable design guidance for developing human-centered writing tools for co-writing with AI, on human terms.
References in corpus (31)
- 'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
- Co-Writing with Opinionated Language Models Affects Users' Views
- The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors
- Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
- A Design Space for Intelligent and Interactive Writing Assistants
- The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers
- VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping
- Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
- Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
- "It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models
- LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia
- RECIPE: How to Integrate ChatGPT into EFL Writing Education
- Writer-Defined AI Personas for On-Demand Feedback Generation
- Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writers
- ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models
- Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writing
- CharacterChat: Supporting the Creation of Fictional Characters through Conversation and Progressive Manifestation with a Chatbot
- Academic Writing with GPT-3.5: Reflections on Practices, Efficacy and Transparency
- Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
- Untangling Critical Interaction with AI in Students Written Assessment
- CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models
- Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
- Effective Interfaces for Student-Driven Revision Sessions for Argumentative Writing
- Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorship
- Storyfier: Exploring Vocabulary Learning Support with Text Generation Models
- Exploring the Effects of AI-assisted Emotional Support Processes in Online Mental Health Community
- Interpretable Directed Diversity: Leveraging Model Explanations for Iterative Crowd Ideation
- Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
- Bridging Learnersourcing and AI: Exploring the Dynamics of Student-AI Collaborative Feedback Generation
- Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learning