Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
arXiv:2408.01057 · doi:10.1145/3711076
Abstract
Recent years have witnessed increasing calls for computing researchers to grapple with the societal impacts of their work. Tools such as impact assessments have gained prominence as a method to uncover potential impacts, and a number of publication venues now encourage authors to include an impact statement in their submissions. Despite this push, little is known about the way researchers assess, articulate, and address the potential negative societal impact of their work -- especially in industry settings, where research outcomes are often quickly integrated into products. In addition, while there are nascent efforts to support researchers in this task, there remains a dearth of empirically-informed tools and processes. Through interviews with 25 industry computing researchers across different companies and research areas, we first identify four key factors that influence how they grapple with (or choose not to grapple with) the societal impact of their research. To develop an effective impact assessment template tailored to industry computing researchers' needs, we conduct an iterative co-design process with these 25 industry researchers and an additional 16 researchers and practitioners with prior experience and expertise in reviewing and developing impact assessments or broad responsible computing practices. Through the co-design process, we develop 10 design considerations to facilitate the effective design, development, and adaptation of an impact assessment template for use in industry research settings and beyond, as well as our own ``Societal Impact Assessment'' template with concrete scaffolds. We explore the effectiveness of this template through a user study with 15 industry research interns, revealing both its strengths and limitations. Finally, we discuss the implications for future researchers and organizations seeking to foster more responsible research practices.
References in corpus (17)
- Problem Formulation and Fairness
- Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
- How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
- Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibility
- Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
- Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
- Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
- Walking the Walk of AI Ethics: Organizational Challenges and the Individualization of Risk among Ethics Entrepreneurs
- Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems
- Supporting Human-AI Collaboration in Auditing LLMs with LLMs
- Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
- Institutionalising Ethics in AI through Broader Impact Requirements
- Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation
- Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
- "That's important, but...": How Computer Science Researchers Anticipate Unintended Consequences of Their Research Innovations
- Unpacking the Expressed Consequences of AI Research in Broader Impact Statements
- REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research