On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Task

Abstract

Deep convolutional neural networks are powerful tools for learning visual representations from images. However, designing efficient deep architectures to analyse volumetric medical images remains challenging. This work investigates efficient and flexible elements of modern convolutional networks such as dilated convolution and residual connection. With these essential building blocks, we propose a high-resolution, compact convolutional network for volumetric image segmentation. To illustrate its efficiency of learning 3D representation from large-scale image data, the proposed network is validated with the challenging task of parcellating 155 neuroanatomical structures from brain MR images. Our experiments show that the proposed network architecture compares favourably with state-of-the-art volumetric segmentation networks while being an order of magnitude more compact. We consider the brain parcellation task as a pretext task for volumetric image segmentation; our trained network potentially provides a good starting point for transfer learning. Additionally, we show the feasibility of voxel-level uncertainty estimation using a sampling approximation through dropout.

Paper accepted at IPMI 2017

References in corpus (2)

• Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
• What makes ImageNet good for transfer learning?

Cited by in corpus (18)

• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge
• CAI4CAI: The Rise of Contextual Artificial Intelligence in Computer Assisted Interventions
• Scalable multimodal convolutional networks for brain tumour segmentation
• Automatic segmentation method of pelvic floor levator hiatus in ultrasound using a self-normalising neural network
• Simulation of Brain Resection for Cavity Segmentation Using Self-Supervised and Semi-Supervised Learning
• 3D Whole Brain Segmentation using Spatially Localized Atlas Network Tiles
• Densely Connected Recurrent Residual (Dense R2UNet) Convolutional Neural Network for Segmentation of Lung CT Images
• Robust Automatic Whole Brain Extraction on Magnetic Resonance Imaging of Brain Tumor Patients using Dense-Vnet
• Deep learning-based attenuation correction in the image domain for myocardial perfusion SPECT imaging
• Reproducibility Evaluation of SLANT Whole Brain Segmentation Across Clinical Magnetic Resonance Imaging Protocols
• Feature-Fused Context-Encoding Network for Neuroanatomy Segmentation
• Atlas-aware ConvNetfor Accurate yet Robust Anatomical Segmentation
• Enhanced generative adversarial network for 3D brain MRI super-resolution
• Holistic Decomposition Convolution for Effective Semantic Segmentation of 3D MR Images
• Longitudinal analysis of fetal MRI in patients with prenatal spina bifida repair
• Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning
• CompareNet: Anatomical Segmentation Network with Deep Non-local Label Fusion