Impact Assessment Card: Communicating Risks and Benefits of AI Uses

Abstract

Communicating the risks and benefits of AI is important for regulation and public understanding. Yet current methods such as technical reports often exclude people without technical expertise. Drawing on HCI research, we developed an Impact Assessment Card to present this information more clearly. We held three focus groups with a total of 12 participants who helped identify design requirements and create early versions of the card. We then tested a refined version in an online study with 235 participants, including AI developers, compliance experts, and members of the public selected to reflect the U.S. population by age, sex, and race. Participants used either the card or a full impact assessment report to write an email supporting or opposing a proposed AI system. The card led to faster task completion and higher-quality emails across all groups. We discuss how design choices can improve accessibility and support AI governance. Examples of cards are available at: https://social-dynamics.net/ai-risks/impact-card/.

42 pages, 14 figures

References in corpus (15)

• Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
• Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors
• Designing for Responsible Trust in AI Systems: A Communication Perspective
• AI Certification: Advancing Ethical Practice by Reducing Information Asymmetries
• Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
• Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
• Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension
• A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
• Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
• My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine Learning
• Matcha: An IDE Plugin for Creating Accurate Privacy Nutrition Labels
• Yes We Care! -- Certification for Machine Learning Methods through the Care Label Framework
• How Do Viewers Synthesize Conflicting Information from Data Visualizations?
• Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
• Atlas of AI Risks: Enhancing Public Understanding of AI Risks