Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models

Abstract

Despite the remarkable performance of deep learning methods on various tasks, most cutting-edge models rely heavily on large-scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling costs for medical images are very high, especially in medical image segmentation, which typically requires intensive pixel/voxel-wise labeling. Therefore, the strong capability of learning and generalizing from limited supervision, including a limited amount of annotations, sparse annotations, and inaccurate annotations, is crucial for the successful application of deep learning models in medical image segmentation. However, due to its intrinsic difficulty, segmentation with limited supervision is challenging and specific model design and/or learning strategies are needed. In this paper, we provide a systematic and up-to-date review of the solutions above, with summaries and comments about the methodologies. We also highlight several problems in this field, discussed future directions observing further investigations.

References in corpus (24)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Conditional Generative Adversarial Nets
• How transferable are features in deep neural networks?
• Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• Improved Regularization of Convolutional Neural Networks with Cutout
• Temporal Ensembling for Semi-Supervised Learning
• Weight Uncertainty in Neural Networks
• Random Erasing Data Augmentation
• Semantic Segmentation using Adversarial Networks
• Patch-based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation
• Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation
• Semi-Supervised Medical Image Segmentation via Learning Consistency under Transformations
• Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network
• Weakly Supervised Vessel Segmentation in X-ray Angiograms by Self-Paced Learning from Noisy Labels with Suggestive Annotation
• Unsupervised Domain Adaptation in Semantic Segmentation: a Review
• Bounding boxes for weakly supervised segmentation: Global constraints get close to full supervision
• A sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation
• Self-Loop Uncertainty: A Novel Pseudo-Label for Semi-Supervised Medical Image Segmentation
• DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets
• Convex Shape Prior for Deep Neural Convolution Network based Eye Fundus Images Segmentation
• Deep Convolutional Neural Networks with Spatial Regularization, Volume and Star-shape Priori for Image Segmentation
• Extreme Consistency: Overcoming Annotation Scarcity and Domain Shifts
• Marginal loss and exclusion loss for partially supervised multi-organ segmentation