Quantitative analysis of patch-based fully convolutional neural networks for tissue segmentation on brain magnetic resonance imaging

Abstract

Accurate brain tissue segmentation in Magnetic Resonance Imaging (MRI) has attracted the attention of medical doctors and researchers since variations in tissue volume help in diagnosing and monitoring neurological diseases. Several proposals have been designed throughout the years comprising conventional machine learning strategies as well as convolutional neural networks (CNN) approaches. In particular, in this paper, we analyse a sub-group of deep learning methods producing dense predictions. This branch, referred in the literature as Fully CNN (FCNN), is of interest as these architectures can process an input volume in less time than CNNs and local spatial dependencies may be encoded since several voxels are classified at once. Our study focuses on understanding architectural strengths and weaknesses of literature-like approaches. Hence, we implement eight FCNN architectures inspired by robust state-of-the-art methods on brain segmentation related tasks. We evaluate them using the IBSR18, MICCAI2012 and iSeg2017 datasets as they contain infant and adult data and exhibit varied voxel spacing, image quality, number of scans and available imaging modalities. The discussion is driven in three directions: comparison between 2D and 3D approaches, the importance of multiple modalities and overlapping as a sampling strategy for training and testing models. To encourage other researchers to explore the evaluation framework, a public version is accessible to download from our research website.

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• A Survey on Deep Learning in Medical Image Analysis
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Automatic segmentation of MR brain images with a convolutional neural network
• 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
• 3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study
• Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review
• Asymmetric Loss Functions and Deep Densely Connected Networks for Highly Imbalanced Medical Image Segmentation: Application to Multiple Sclerosis Lesion Detection
• Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation
• Automated sub-cortical brain structure segmentation combining spatial and deep convolutional features
• VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation
• Highly Efficient Forward and Backward Propagation of Convolutional Neural Networks for Pixelwise Classification
• Adversarial training and dilated convolutions for brain MRI segmentation
• White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks

Cited by in corpus (5)

• Asymmetric Loss Functions and Deep Densely Connected Networks for Highly Imbalanced Medical Image Segmentation: Application to Multiple Sclerosis Lesion Detection
• hist2RNA: An efficient deep learning architecture to predict gene expression from breast cancer histopathology images
• DARTS: DenseUnet-based Automatic Rapid Tool for brain Segmentation
• Myocardial Infarction Quantification From Late Gadolinium Enhancement MRI Using Top-hat Transforms and Neural Networks
• Deep Cerebellar Nuclei Segmentation via Semi-Supervised Deep Context-Aware Learning from 7T Diffusion MRI