Co-Writing with Opinionated Language Models Affects Users' Views
arXiv:2302.00560 · doi:10.1145/3544548.3581196
Abstract
If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write - and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.
References in corpus (13)
- Semantics derived automatically from language corpora contain human-like biases
- On the Opportunities and Risks of Foundation Models
- The Rise of Social Bots
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
- Human heuristics for AI-generated language are flawed
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
- TruthfulQA: Measuring How Models Mimic Human Falsehoods
- How Different Groups Prioritize Ethical Values for Responsible AI
- The anatomy of Reddit: An overview of academic research
- The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers
- Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
- Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorship
- Persuasive Natural Language Generation -- A Literature Review
Cited by in corpus (32)
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- The Robots are Here: Navigating the Generative AI Revolution in Computing Education
- The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors
- Homogenization Effects of Large Language Models on Human Creative Ideation
- A Design Space for Intelligent and Interactive Writing Assistants
- The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships
- How Knowledge Workers Think Generative AI Will (Not) Transform Their Industries
- AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
- From Text to Self: Users' Perceptions of Potential of AI on Interpersonal Communication and Self
- Writer-Defined AI Personas for On-Demand Feedback Generation
- Exploring Perspectives on the Impact of Artificial Intelligence on the Creativity of Knowledge Work: Beyond Mechanised Plagiarism and Stochastic Parrots
- User Interaction Patterns and Breakdowns in Conversing with LLM-Powered Voice Assistants
- LessonPlanner: Assisting Novice Teachers to Prepare Pedagogy-Driven Lesson Plans with Large Language Models
- Help Me Reflect: Leveraging Self-Reflection Interface Nudges to Enhance Deliberativeness on Online Deliberation Platforms
- ReviewFlow: Intelligent Scaffolding to Support Academic Peer Reviewing
- ExpressEdit: Video Editing with Natural Language and Sketching
- Ai.llude: Encouraging Rewriting AI-Generated Text to Support Creative Expression
- Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
- Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools
- Timing Matters: How Using LLMs at Different Timings Influences Writers' Perceptions and Ideation Outcomes in AI-Assisted Ideation
- Mapping the individual, social, and biospheric impacts of Foundation Models
- Public Attitudes Toward ChatGPT on Twitter: Sentiments, Topics, and Occupations
- Accuracy and Political Bias of News Source Credibility Ratings by Large Language Models
- Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces
- CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents
- AI Language Models Could Both Help and Harm Equity in Marine Policymaking: The Case Study of the BBNJ Question-Answering Bot
- Should AI Mimic People? Understanding AI-Supported Writing Technology Among Black Users
- Thoughtful, Confused, or Untrustworthy: How Text Presentation Influences Perceptions of AI Writing Tools
- Enhancing Deliberativeness: Evaluating the Impact of Multimodal Reflection Nudges
- Examining Human-AI Collaboration for Co-Writing Constructive Comments Online
- Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation
- "Mango Mango, How to Let The Lettuce Dry Without A Spinner?": Exploring User Perceptions of Using An LLM-Based Conversational Assistant Toward Cooking Partner