Impact Assessment Card: Communicating Risks and Benefits of AI Uses

Abstract

Communicating the risks and benefits of AI is important for regulation and public understanding. Yet current methods such as technical reports often exclude people without technical expertise. Drawing on HCI research, we developed an Impact Assessment Card to present this information more clearly. We held three focus groups with a total of 12 participants who helped identify design requirements and create early versions of the card. We then tested a refined version in an online study with 235 participants, including AI developers, compliance experts, and members of the public selected to reflect the U.S. population by age, sex, and race. Participants used either the card or a full impact assessment report to write an email supporting or opposing a proposed AI system. The card led to faster task completion and higher-quality emails across all groups. We discuss how design choices can improve accessibility and support AI governance. Examples of cards are available at: https://social-dynamics.net/ai-risks/impact-card/.

42 pages, 14 figures

References in corpus (9)

• Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
• Designing for Responsible Trust in AI Systems: A Communication Perspective
• AI Certification: Advancing Ethical Practice by Reducing Information Asymmetries
• Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
• Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension
• A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
• Matcha: An IDE Plugin for Creating Accurate Privacy Nutrition Labels
• How Do Viewers Synthesize Conflicting Information from Data Visualizations?
• Atlas of AI Risks: Enhancing Public Understanding of AI Risks