VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation

Abstract

Recently deep residual learning with residual units for training very deep neural networks advanced the state-of-the-art performance on 2D image recognition tasks, e.g., object detection and segmentation. However, how to fully leverage contextual representations for recognition tasks from volumetric data has not been well studied, especially in the field of medical image computing, where a majority of image modalities are in volumetric format. In this paper we explore the deep residual learning on the task of volumetric brain segmentation. There are at least two main contributions in our work. First, we propose a deep voxelwise residual network, referred as VoxResNet, which borrows the spirit of deep residual learning in 2D image recognition tasks, and is extended into a 3D variant for handling volumetric data. Second, an auto-context version of VoxResNet is proposed by seamlessly integrating the low-level image appearance features, implicit shape information and high-level context together for further improving the volumetric segmentation performance. Extensive experiments on the challenging benchmark of brain segmentation from magnetic resonance (MR) images corroborated the efficacy of our proposed method in dealing with volumetric data. We believe this work unravels the potential of 3D deep learning to advance the recognition performance on volumetric image segmentation.

References in corpus (2)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Caffe: Convolutional Architecture for Fast Feature Embedding

Cited by in corpus (9)

• Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks
• Deep Learning for Lung Cancer Detection: Tackling the Kaggle Data Science Bowl 2017 Challenge
• Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities
• Residual and Plain Convolutional Neural Networks for 3D Brain MRI Classification
• Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
• Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach
• Spatial Aggregation of Holistically-Nested Convolutional Neural Networks for Automated Pancreas Localization and Segmentation
• Learning Normalized Inputs for Iterative Estimation in Medical Image Segmentation
• Cascade Decoder: A Universal Decoding Method for Biomedical Image Segmentation