Simultaneous synthesis of FLAIR and segmentation of white matter hypointensities from T1 MRIs

Abstract

Segmenting vascular pathologies such as white matter lesions in Brain magnetic resonance images (MRIs) require acquisition of multiple sequences such as T1-weighted (T1-w) --on which lesions appear hypointense-- and fluid attenuated inversion recovery (FLAIR) sequence --where lesions appear hyperintense--. However, most of the existing retrospective datasets do not consist of FLAIR sequences. Existing missing modality imputation methods separate the process of imputation, and the process of segmentation. In this paper, we propose a method to link both modality imputation and segmentation using convolutional neural networks. We show that by jointly optimizing the imputation network and the segmentation network, the method not only produces more realistic synthetic FLAIR images from T1-w images, but also improves the segmentation of WMH from T1-w images only.

arXiv commentConference on Medical Imaging with Deep Learning MIDL 2018

References in corpus (6)

• A Survey on Deep Learning in Medical Image Analysis
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Fully Convolutional Network Ensembles for White Matter Hyperintensities Segmentation in MR Images
• A Bayesian Data Augmentation Approach for Learning Deep Models
• Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network
• Adversarial Synthesis Learning Enables Segmentation Without Target Modality Ground Truth

Cited by in corpus (4)

• Artificial Intelligence in Glioma Imaging: Challenges and Advances
• Brain MRI Tumor Segmentation with Adversarial Networks
• Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation
• Knowledge distillation from multi-modal to mono-modal segmentation networks