CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysis

Abstract

The recent development of data-driven AI promises to automate medical diagnosis; however, most AI functions as 'black boxes' to physicians with limited computational knowledge. Using medical imaging as a point of departure, we conducted three iterations of design activities to formulate CheXplain---a system that enables physicians to explore and understand AI-enabled chest X-ray analysis: (1) a paired survey between referring physicians and radiologists reveals whether, when, and what kinds of explanations are needed; (2) a low-fidelity prototype co-designed with three physicians formulates eight key features; and (3) a high-fidelity prototype evaluated by another six physicians provides detailed summative insights on how each feature enables the exploration and understanding of AI. We summarize by discussing recommendations for future work to design and implement explainable medical AI systems that encompass four recurring themes: motivation, constraint, explanation, and justification.

10 pages, 5 figures

References in corpus (1)

• Interpretable Explanations of Black Boxes by Meaningful Perturbation

Cited by in corpus (14)

• Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens
• Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
• Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
• XAIR: A Framework of Explainable AI in Augmented Reality
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
• Seamful XAI: Operationalizing Seamful Design in Explainable AI
• The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
• Explanation Strategies as an Empirical-Analytical Lens for Socio-Technical Contextualization of Machine Learning Interpretability
• How Can We Develop Explainable Systems? Insights from a Literature Review and an Interview Study
• Comparing Zealous and Restrained AI Recommendations in a Real-World Human-AI Collaboration Task
• 3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration
• MiMICRI: Towards Domain-centered Counterfactual Explanations of Cardiovascular Image Classification Models
• "It depends": Configuring AI to Improve Clinical Usefulness Across Contexts