Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists

Abstract

Despite the promises of data-driven artificial intelligence (AI), little is known about how we can bridge the gulf between traditional physician-driven diagnosis and a plausible future of medicine automated by AI. Specifically, how can we involve AI usefully in physicians' diagnosis workflow given that most AI is still nascent and error-prone (e.g., in digital pathology)? To explore this question, we first propose a series of collaborative techniques to engage human pathologists with AI given AI's capabilities and limitations, based on which we prototype Impetus - a tool where an AI takes various degrees of initiatives to provide various forms of assistance to a pathologist in detecting tumors from histological slides. We summarize observations and lessons learned from a study with eight pathologists and discuss recommendations for future work on human-centered medical AI systems.

arXiv comment25 pages, 5 figures. To appear in the 24th ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2021)

References in corpus (12)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Attention-based Deep Multiple Instance Learning
• Assessment of algorithms for mitosis detection in breast cancer histopathology images
• Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
• Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
• Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification
• Similar Image Search for Histopathology: SMILY
• CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysis
• Machine Teaching: A New Paradigm for Building Machine Learning Systems
• Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology
• MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network
• Outlining the Design Space of Explainable Intelligent Systems for Medical Diagnosis

Cited by in corpus (8)

• Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System
• Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review
• GANravel: User-Driven Direction Disentanglement in Generative Adversarial Networks
• The AI-DEC: A Card-based Design Method for User-centered AI Explanations
• "It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
• Practically implementing an LLM-supported collaborative vulnerability remediation process: a team-based approach
• Translating Emotions to Annotations -- A Participant Perspective of Physiological Emotion Data Collection
• Hierarchical Decision Ensembles- An inferential framework for uncertain Human-AI collaboration in forensic examinations