Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentation

Abstract

Existing interactive segmentation methods leverage automatic segmentation and user interactions for label refinement, significantly reducing the annotation workload compared to manual annotation. However, these methods lack quick adaptability to ambiguous and noisy data, which is a challenge in CT volumes containing lung lesions from COVID-19 patients. In this work, we propose an adaptive multi-scale online likelihood network (MONet) that adaptively learns in a data-efficient online setting from both an initial automatic segmentation and user interactions providing corrections. We achieve adaptive learning by proposing an adaptive loss that extends the influence of user-provided interaction to neighboring regions with similar features. In addition, we propose a data-efficient probability-guided pruning method that discards uncertain and redundant labels in the initial segmentation to enable efficient online training and inference. Our proposed method was evaluated by an expert in a blinded comparative study on COVID-19 lung lesion annotation task in CT. Our approach achieved 5.86% higher Dice score with 24.67% less perceived NASA-TLX workload score than the state-of-the-art. Source code is available at: https://github.com/masadcv/MONet-MONAILabel

References in corpus (9)

• Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuning
• The Real-World-Weight Cross-Entropy Loss Function: Modeling the Costs of Mislabeling
• A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
• DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
• MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learning
• Manual segmentation versus semi-automated segmentation for quantifying vestibular schwannoma volume on MRI
• FastGeodis: Fast Generalised Geodesic Distance Transform
• Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentation
• Interactive Segmentation via Deep Learning and B-Spline Explicit Active Surfaces

Cited by in corpus (1)

• Adaptive Multi-scale Online Likelihood Network for AI-assisted Interactive Segmentation