A Model-Driven Stack-Based Fully Convolutional Network for Pancreas Segmentation

Abstract

The irregular geometry and high inter-slice variability in computerized tomography (CT) scans of the human pancreas make an accurate segmentation of this crucial organ a challenging task for existing data-driven deep learning methods. To address this problem, we present a novel model-driven stack-based fully convolutional network with a sliding window fusion algorithm for pancreas segmentation, termed MDS-Net. The MDS-Net's cost function includes a data approximation term and a prior knowledge regularization term combined with a stack scheme for capturing and fusing the two-dimensional (2D) and local three-dimensional (3D) context information. Specifically, 3D CT scans are divided into multiple stacks to capture the local spatial context feature. To highlight the importance of single slices, the inter-slice relationships in the stack data are also incorporated in the MDS-Net framework. For implementing this proposed model-driven method, we create a stack-based U-Net architecture and successfully derive its back-propagation procedure for end-to-end training. Furthermore, a sliding window fusion algorithm is utilized to improve the consistency of adjacent CT slices and intra-stack. Finally, extensive quantitative assessments on the NIH Pancreas-CT dataset demonstrated higher pancreatic segmentation accuracy and reliability of MDS-Net compared to other state-of-the-art methods.

References in corpus (10)

• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• LSTM: A Search Space Odyssey
• Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields
• An application of cascaded 3D fully convolutional networks for medical image segmentation
• UNet++: A Nested U-Net Architecture for Medical Image Segmentation
• Improving Deep Pancreas Segmentation in CT and MRI Images via Recurrent Neural Contextual Learning and Direct Loss Function
• Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection
• Pancreas Segmentation in CT and MRI Images via Domain Specific Network Designing and Recurrent Neural Contextual Learning
• Model-Driven Deep Learning for Physical Layer Communications
• Joint CS-MRI Reconstruction and Segmentation with a Unified Deep Network

Cited by in corpus (2)

• Recurrent U-net for automatic pelvic floor muscle segmentation on 3D ultrasound
• Bidirectional RNN-based Few Shot Learning for 3D Medical Image Segmentation