Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System

Abstract

Artificial Intelligence (AI) brings advancements to support pathologists in navigating high-resolution tumor images to search for pathology patterns of interest. However, existing AI-assisted tools have not realized this promised potential due to a lack of insight into pathology and HCI considerations for pathologists' navigation workflows in practice. We first conducted a formative study with six medical professionals in pathology to capture their navigation strategies. By incorporating our observations along with the pathologists' domain knowledge, we designed NaviPath -- a human-AI collaborative navigation system. An evaluation study with 15 medical professionals in pathology indicated that: (i) compared to the manual navigation, participants saw more than twice the number of pathological patterns in unit time with NaviPath, and (ii) participants achieved higher precision and recall against the AI and the manual navigation on average. Further qualitative analysis revealed that navigation was more consistent with NaviPath, which can improve the overall examination quality.

arXiv commentAccepted ACM CHI Conference on Human Factors in Computing Systems (CHI '23)

References in corpus (16)

• To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
• Deep Learning for Identifying Metastatic Breast Cancer
• Interpretability of machine learning based prediction models in healthcare
• Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
• Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks
• Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
• "Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment
• Artificial Intelligence Assistance Significantly Improves Gleason Grading of Prostate Biopsies by Pathologists
• A completely annotated whole slide image dataset of canine breast cancer to aid human breast cancer research
• Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
• Survey of XAI in digital pathology
• BreastScreening: On the Use of Multi-Modality in Medical Imaging Diagnosis
• Scope2Screen: Focus+Context Techniques for Pathology Tumor Assessment in Multivariate Image Data
• GANzilla: User-Driven Direction Discovery in Generative Adversarial Networks
• Quantifying the Scanner-Induced Domain Gap in Mitosis Detection
• Detecting Mitoses with a Convolutional Neural Network for MIDOG 2022 Challenge

Cited by in corpus (4)

• Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
• A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
• Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
• Surgment: Segmentation-enabled Semantic Search and Creation of Visual Question and Feedback to Support Video-Based Surgery Learning