Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools
arXiv:2405.17217 · doi:10.1145/3643834.3660681
Abstract
This essay proposes and explores the concept of Collage for the design of AI writing tools, transferred from avant-garde literature with four facets: 1) fragmenting text in writing interfaces, 2) juxtaposing voices (content vs command), 3) integrating material from multiple sources (e.g. text suggestions), and 4) shifting from manual writing to editorial and compositional decision-making, such as selecting and arranging snippets. The essay then employs Collage as an analytical lens to analyse the user interface design of recent AI writing tools, and as a constructive lens to inspire new design directions. Finally, a critical perspective relates the concerns that writers historically expressed through literary collage to AI writing tools. In a broad view, this essay explores how literary concepts can help advance design theory around AI writing tools. It encourages creators of future writing tools to engage not only with new technological possibilities, but also with past writing innovations.
19 pages, 7 figures, 2 tables, ACM DIS 2024
References in corpus (20)
- Survey of Hallucination in Natural Language Generation
- Showing Academic Performance Predictions during Term Planning: Effects on Students' Decisions, Behaviors, and Preferences
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
- The Metacognitive Demands and Opportunities of Generative AI
- Co-Writing with Opinionated Language Models Affects Users' Views
- The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors
- A Design Space for Intelligent and Interactive Writing Assistants
- The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers
- VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping
- Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
- Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
- LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia
- Writer-Defined AI Personas for On-Demand Feedback Generation
- Do Language Models Plagiarize?
- Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writing
- Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
- CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models
- Effective Interfaces for Student-Driven Revision Sessions for Argumentative Writing
- Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorship
- Storyfier: Exploring Vocabulary Learning Support with Text Generation Models
Cited by in corpus (4)
- Textoshop: Interactions Inspired by Drawing Software to Facilitate Text Editing
- Exploring Mobile Touch Interaction with Large Language Models
- Visual Story-Writing: Writing by Manipulating Visual Representations of Stories
- From Planning to Revision: How AI Writing Support at Different Stages Alters Ownership