Improving Human-AI Collaboration With Descriptions of AI Behavior
arXiv:2301.06937 · doi:10.1145/3579612
Abstract
People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior descriptions, details of how AI systems perform on subgroups of instances. We tested the efficacy of behavior descriptions through user studies with 225 participants in three distinct domains: fake review detection, satellite image classification, and bird classification. We found that behavior descriptions can increase human-AI accuracy through two mechanisms: helping people identify AI failures and increasing people's reliance on the AI when it is more accurate. These findings highlight the importance of people's mental models in human-AI collaboration and show that informing people of high-level AI behaviors can significantly improve AI-assisted decision making.
21 pages
References in corpus (7)
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- Improving fairness in machine learning systems: What do industry practitioners need?
- Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Making
- Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
- A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
- Discovering and Validating AI Errors With Crowdsourced Failure Reports
- Machine Learning Practices Outside Big Tech: How Resource Constraints Challenge Responsible Development
Cited by in corpus (5)
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- The Impact of Imperfect XAI on Human-AI Decision-Making
- Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey
- AI That Helps Us Help Each Other: A Proactive System for Scaffolding Mentor-Novice Collaboration in Entrepreneurship Coaching
- Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performance