Brain MRI Tumor Segmentation with Adversarial Networks

Abstract

Deep Learning is a promising approach to either automate or simplify several tasks in the healthcare domain. In this work, we introduce SegAN-CAT, an approach to brain tumor segmentation in Magnetic Resonance Images (MRI), based on Adversarial Networks. In particular, we extend SegAN, successfully applied to the same task in a previous work, in two respects: (i) we used a different model input and (ii) we employed a modified loss function to train the model. We tested our approach on two large datasets, made available by the Brain Tumor Image Segmentation Benchmark (BraTS). First, we trained and tested some segmentation models assuming the availability of all the major MRI contrast modalities, i.e., T1-weighted, T1 weighted contrast-enhanced, T2-weighted, and T2-FLAIR. However, as these four modalities are not always all available for each patient, we also trained and tested four segmentation models that take as input MRIs acquired only with a single contrast modality. Finally, we proposed to apply transfer learning across different contrast modalities to improve the performance of these single-modality models. Our results are promising and show that not SegAN-CAT is able to outperform SegAN when all the four modalities are available, but also that transfer learning can actually lead to better performances when only a single modality is available.

References in corpus (14)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Auto-Encoding Variational Bayes
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• How transferable are features in deep neural networks?
• Brain Tumor Segmentation with Deep Neural Networks
• An introduction to Docker for reproducible research, with examples from the R environment
• SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation
• Wasserstein GAN
• Semantic Segmentation using Adversarial Networks
• Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities
• Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation
• Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation
• Simultaneous synthesis of FLAIR and segmentation of white matter hypointensities from T1 MRIs
• A Transfer Learning Approach for Automated Segmentation of Prostate Whole Gland and Transition Zone in Diffusion Weighted MRI

Cited by in corpus (1)

• Comparing Adversarial and Supervised Learning for Organs at Risk Segmentation in CT images