Interactive segmentation of medical images through fully convolutional neural networks

Abstract

Image segmentation plays an essential role in medicine for both diagnostic and interventional tasks. Segmentation approaches are either manual, semi-automated or fully-automated. Manual segmentation offers full control over the quality of the results, but is tedious, time consuming and prone to operator bias. Fully automated methods require no human effort, but often deliver sub-optimal results without providing users with the means to make corrections. Semi-automated approaches keep users in control of the results by providing means for interaction, but the main challenge is to offer a good trade-off between precision and required interaction. In this paper we present a deep learning (DL) based semi-automated segmentation approach that aims to be a "smart" interactive tool for region of interest delineation in medical images. We demonstrate its use for segmenting multiple organs on computed tomography (CT) of the abdomen. Our approach solves some of the most pressing clinical challenges: (i) it requires only one to a few user clicks to deliver excellent 2D segmentations in a fast and reliable fashion; (ii) it can generalize to previously unseen structures and "corner cases"; (iii) it delivers results that can be corrected quickly in a smart and intuitive way up to an arbitrary degree of precision chosen by the user and (iv) ensures high accuracy. We present our approach and compare it to other techniques and previous work to show the advantages brought by our method.

References in corpus (8)

• A large annotated medical image dataset for the development and evaluation of segmentation algorithms
• DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
• 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
• nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation
• DLTK: State of the Art Reference Implementations for Deep Learning on Medical Images
• Deep Interactive Object Selection
• Deep Extreme Cut: From Extreme Points to Object Segmentation
• A multi-scale pyramid of 3D fully convolutional networks for abdominal multi-organ segmentation

Cited by in corpus (11)

• Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
• MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learning
• MONAI Label: A framework for AI-assisted Interactive Labeling of 3D Medical Images
• 3DSAM-adapter: Holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation
• CycleSegNet: Object Co-segmentation with Cycle Refinement and Region Correspondence
• Hyper-Fusion Network for Semi-Automatic Segmentation of Skin Lesions
• Weakly supervised segmentation from extreme points
• NuClick: A Deep Learning Framework for Interactive Segmentation of Microscopy Images
• Interactive Segmentation via Deep Learning and B-Spline Explicit Active Surfaces
• Tips and Tricks to Improve CNN-based Chest X-ray Diagnosis: A Survey
• ErrorNet: Learning error representations from limited data to improve vascular segmentation