Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities
arXiv:1704.03379 · doi:10.1007/978-3-319-46723-8_55
Abstract
Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a single convolutional neural network (CNN) can be trained to perform different segmentation tasks. A single CNN is trained to segment six tissues in MR brain images, the pectoral muscle in MR breast images, and the coronary arteries in cardiac CTA. The CNN therefore learns to identify the imaging modality, the visualised anatomical structures, and the tissue classes. For each of the three tasks (brain MRI, breast MRI and cardiac CTA), this combined training procedure resulted in a segmentation performance equivalent to that of a CNN trained specifically for that task, demonstrating the high capacity of CNN architectures. Hence, a single system could be used in clinical practice to automatically perform diverse segmentation tasks without task-specific training.
References in corpus (3)
Cited by in corpus (31)
- A Survey on Deep Learning in Medical Image Analysis
- ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases
- A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
- Deep learning for cardiac image segmentation: A review
- Medical Image Segmentation Using Deep Learning: A Survey
- A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
- A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
- Coronary Artery Centerline Extraction in Cardiac CT Angiography Using a CNN-Based Orientation Classifier
- A Distance Map Regularized CNN for Cardiac Cine MR Image Segmentation
- A two-stage 3D Unet framework for multi-class segmentation on full resolution image
- Learning joint segmentation of tissues and brain lesions from task-specific hetero-modal domain-shifted datasets
- A Survey on Deep Learning of Small Sample in Biomedical Image Analysis
- Uncertainty in multitask learning: joint representations for probabilistic MR-only radiotherapy planning
- Brain MRI Tumor Segmentation with Adversarial Networks
- Unsupervised Medical Image Segmentation with Adversarial Networks: From Edge Diagrams to Segmentation Maps
- Unpaired Multi-modal Segmentation via Knowledge Distillation
- 3D U-Net: A 3D Universal U-Net for Multi-Domain Medical Image Segmentation
- Unsupervised domain adaptation in brain lesion segmentation with adversarial networks
- Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation
- A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation
- Less is More: Simultaneous View Classification and Landmark Detection for Abdominal Ultrasound Images
- Joint Learning of Brain Lesion and Anatomy Segmentation from Heterogeneous Datasets
- Response monitoring of breast cancer on DCE-MRI using convolutional neural network-generated seed points and constrained volume growing
- TricycleGAN: Unsupervised Image Synthesis and Segmentation Based on Shape Priors
- Transfer Learning from Partial Annotations for Whole Brain Segmentation
- Multi-task Learning by Leveraging the Semantic Information
- Improving Calibration and Out-of-Distribution Detection in Medical Image Segmentation with Convolutional Neural Networks
- Computation of Total Kidney Volume from CT images in Autosomal Dominant Polycystic Kidney Disease using Multi-Task 3D Convolutional Neural Networks
- On segmentation of pectoralis muscle in digital mammograms by means of deep learning
- Learning from Partially Overlapping Labels: Image Segmentation under Annotation Shift
- CANet: Cross-disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading