Interactive Medical Image Segmentation with Self-Adaptive Confidence Calibration

Abstract

Medical image segmentation is one of the fundamental problems for artificial intelligence-based clinical decision systems. Current automatic medical image segmentation methods are often failed to meet clinical requirements. As such, a series of interactive segmentation algorithms are proposed to utilize expert correction information. However, existing methods suffer from some segmentation refining failure problems after long-term interactions and some cost problems from expert annotation, which hinder clinical applications. This paper proposes an interactive segmentation framework, called interactive MEdical segmentation with self-adaptive Confidence CAlibration (MECCA), by introducing the corrective action evaluation, which combines the action-based confidence learning and multi-agent reinforcement learning (MARL). The evaluation is established through a novel action-based confidence network, and the corrective actions are obtained from MARL. Based on the confidential information, a self-adaptive reward function is designed to provide more detailed feedback, and a simulated label generation mechanism is proposed on unsupervised data to reduce over-reliance on labeled data. Experimental results on various medical image datasets have shown the significant performance of the proposed algorithm.

References in corpus (15)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
• Focal Loss for Dense Object Detection
• Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuning
• A large annotated medical image dataset for the development and evaluation of segmentation algorithms
• DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
• Learning Confidence for Out-of-Distribution Detection in Neural Networks
• Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentation
• Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation
• Leveraging Uncertainty Estimates for Predicting Segmentation Quality
• Annotating Object Instances with a Polygon-RNN
• Adversarial training and dilated convolutions for brain MRI segmentation
• Real-time Prediction of Segmentation Quality
• Iterative Interaction Training for Segmentation Editing Networks