Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation

Abstract

Image segmentation is a fundamental problem in biomedical image analysis. Recent advances in deep learning have achieved promising results on many biomedical image segmentation benchmarks. However, due to large variations in biomedical images (different modalities, image settings, objects, noise, etc), to utilize deep learning on a new application, it usually needs a new set of training data. This can incur a great deal of annotation effort and cost, because only biomedical experts can annotate effectively, and often there are too many instances in images (e.g., cells) to annotate. In this paper, we aim to address the following question: With limited effort (e.g., time) for annotation, what instances should be annotated in order to attain the best performance? We present a deep active learning framework that combines fully convolutional network (FCN) and active learning to significantly reduce annotation effort by making judicious suggestions on the most effective annotation areas. We utilize uncertainty and similarity information provided by FCN and formulate a generalized version of the maximum set cover problem to determine the most representative and uncertain areas for annotation. Extensive experiments using the 2015 MICCAI Gland Challenge dataset and a lymph node ultrasound image segmentation dataset show that, using annotation suggestions by our method, state-of-the-art segmentation performance can be achieved by using only 50% of training data.

Accepted at MICCAI 2017

References in corpus (1)

• Gland Instance Segmentation Using Deep Multichannel Neural Networks

Cited by in corpus (9)

• MILD-Net: Minimal Information Loss Dilated Network for Gland Instance Segmentation in Colon Histology Images
• Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
• Unsupervised Histopathology Image Synthesis
• A semi-supervised self-training method to develop assistive intelligence for segmenting multiclass bridge elements from inspection videos
• CEREALS - Cost-Effective REgion-based Active Learning for Semantic Segmentation
• A New Ensemble Learning Framework for 3D Biomedical Image Segmentation
• Reversed Active Learning based Atrous DenseNet for Pathological Image Classification
• Importance of Self-Consistency in Active Learning for Semantic Segmentation
• Calpric: Inclusive and Fine-grain Labeling of Privacy Policies with Crowdsourcing and Active Learning