"That's important, but...": How Computer Science Researchers Anticipate Unintended Consequences of Their Research Innovations
arXiv:2303.15536 · doi:10.1145/3544548.3581347
Abstract
Computer science research has led to many breakthrough innovations but has also been scrutinized for enabling technology that has negative, unintended consequences for society. Given the increasing discussions of ethics in the news and among researchers, we interviewed 20 researchers in various CS sub-disciplines to identify whether and how they consider potential unintended consequences of their research innovations. We show that considering unintended consequences is generally seen as important but rarely practiced. Principal barriers are a lack of formal process and strategy as well as the academic practice that prioritizes fast progress and publications. Drawing on these findings, we discuss approaches to support researchers in routinely considering unintended consequences, from bringing diverse perspectives through community participation to increasing incentives to investigate potential consequences. We intend for our work to pave the way for routine explorations of the societal implications of technological innovations before, during, and after the research process.
Corresponding author: Rock Yuren Pang, email provided below. Kimberly Do and Rock Yuren Pang contributed equally to this research. The author order is listed alphabetically. To appear in CHI Conference on Human Factors in Computing Systems (CHI '23), April 23-April 28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 16 pages
References in corpus (6)
- Power to the People? Opportunities and Challenges for Participatory AI
- Institutionalising Ethics in AI through Broader Impact Requirements
- It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process
- Unpacking the Expressed Consequences of AI Research in Broader Impact Statements
- Anticipatory Ethics and the Role of Uncertainty
- Atomist or Holist? A Diagnosis and Vision for More Productive Interdisciplinary AI Ethics Dialogue