The illusion of artificial inclusion

Abstract

Human participants play a central role in the development of modern artificial intelligence (AI) technology, in psychological science, and in user research. Recent advances in generative AI have attracted growing interest to the possibility of replacing human participants in these domains with AI surrogates. We survey several such "substitution proposals" to better understand the arguments for and against substituting human participants with modern generative AI. Our scoping review indicates that the recent wave of these proposals is motivated by goals such as reducing the costs of research and development work and increasing the diversity of collected data. However, these proposals ignore and ultimately conflict with foundational values of work with human participants: representation, inclusion, and understanding. This paper critically examines the principles and goals underlying human participation to help chart out paths for future work that truly centers and empowers participants.

Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI 2024)

References in corpus (8)

• Artificial Intelligence: the global landscape of ethics guidelines
• Survey of Hallucination in Natural Language Generation
• Flamingo: a Visual Language Model for Few-Shot Learning
• ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks
• Out of One, Many: Using Language Models to Simulate Human Samples
• Power to the People? Opportunities and Challenges for Participatory AI
• Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing
• Regional Differences in Information Privacy Concerns After the Facebook-Cambridge Analytica Data Scandal

Cited by in corpus (8)

• Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention
• The Value-Sensitive Conversational Agent Co-Design Framework
• Risk or Chance? Large Language Models and Reproducibility in HCI Research
• LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions
• Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practice
• Six Fallacies in Substituting Large Language Models for Human Participants
• Recommending With, Not For: Co-Designing Recommender Systems for Social Good
• Social Perception of Faces in a Vision-Language Model