A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation
arXiv:1712.00201
Abstract
In this paper, we adopt 3D Convolutional Neural Networks to segment volumetric medical images. Although deep neural networks have been proven to be very effective on many 2D vision tasks, it is still challenging to apply them to 3D tasks due to the limited amount of annotated 3D data and limited computational resources. We propose a novel 3D-based coarse-to-fine framework to effectively and efficiently tackle these challenges. The proposed 3D-based framework outperforms the 2D counterpart to a large margin since it can leverage the rich spatial infor- mation along all three axes. We conduct experiments on two datasets which include healthy and pathological pancreases respectively, and achieve the current state-of-the-art in terms of Dice-Sørensen Coefficient (DSC). On the NIH pancreas segmentation dataset, we outperform the previous best by an average of over 2%, and the worst case is improved by 7% to reach almost 70%, which indicates the reliability of our framework in clinical applications.
9 pages, 4 figures, Accepted to 3DV
References in corpus (12)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Caffe: Convolutional Architecture for Fast Feature Embedding
- Fully Convolutional Networks for Semantic Segmentation
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
- Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities
- DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation
- Improving Deep Pancreas Segmentation in CT and MRI Images via Recurrent Neural Contextual Learning and Direct Loss Function
- 3D Densely Convolutional Networks for Volumetric Segmentation
- Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets
- Spatial Aggregation of Holistically-Nested Networks for Automated Pancreas Segmentation
- Deep Supervision for Pancreatic Cyst Segmentation in Abdominal CT Scans