Abdominal multi-organ segmentation with organ-attention networks and statistical fusion

Abstract

Accurate and robust segmentation of abdominal organs on CT is essential for many clinical applications such as computer-aided diagnosis and computer-aided surgery. But this task is challenging due to the weak boundaries of organs, the complexity of the background, and the variable sizes of different organs. To address these challenges, we introduce a novel framework for multi-organ segmentation by using organ-attention networks with reverse connections (OAN-RCs) which are applied to 2D views, of the 3D CT volume, and output estimates which are combined by statistical fusion exploiting structural similarity. OAN is a two-stage deep convolutional network, where deep network features from the first stage are combined with the original image, in a second stage, to reduce the complex background and enhance the discriminative information for the target organs. RCs are added to the first stage to give the lower layers semantic information thereby enabling them to adapt to the sizes of different organs. Our networks are trained on 2D views enabling us to use holistic information and allowing efficient computation. To compensate for the limited cross-sectional information of the original 3D volumetric CT, multi-sectional images are reconstructed from the three different 2D view directions. Then we combine the segmentation results from the different views using statistical fusion, with a novel term relating the structural similarity of the 2D views to the original 3D structure. To train the network and evaluate results, 13 structures were manually annotated by four human raters and confirmed by a senior expert on 236 normal cases. We tested our algorithm and computed Dice-Sorensen similarity coefficients and surface distances for evaluating our estimates of the 13 structures. Our experiments show that the proposed approach outperforms 2D- and 3D-patch based state-of-the-art methods.

21 pages, 11 figures

References in corpus (10)

• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Brain Tumor Segmentation with Deep Neural Networks
• Fully Convolutional Networks for Semantic Segmentation
• An application of cascaded 3D fully convolutional networks for medical image segmentation
• Holistically-Nested Edge Detection
• Deep convolutional networks for pancreas segmentation in CT imaging
• Hierarchical 3D fully convolutional networks for multi-organ segmentation
• 3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes
• RON: Reverse Connection with Objectness Prior Networks for Object Detection
• Towards dense volumetric pancreas segmentation in CT using 3D fully convolutional networks

Cited by in corpus (27)

• Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systems
• WORD: A large scale dataset, benchmark and clinical applicable study for abdominal organ segmentation from CT image
• Inter-slice Context Residual Learning for 3D Medical Image Segmentation
• Fully Automated Multi-Organ Segmentation in Abdominal Magnetic Resonance Imaging with Deep Neural Networks
• Prior-aware Neural Network for Partially-Supervised Multi-Organ Segmentation
• Learning Inductive Attention Guidance for Partially Supervised Pancreatic Ductal Adenocarcinoma Prediction
• SliceMamba with Neural Architecture Search for Medical Image Segmentation
• Deep Learning for Pancreas Segmentation: a Systematic Review
• Mediastinal lymph nodes segmentation using 3D convolutional neural network ensembles and anatomical priors guiding
• Semi-Supervised Multi-Organ Segmentation via Deep Multi-Planar Co-Training
• Robust End-to-End Focal Liver Lesion Detection using Unregistered Multiphase Computed Tomography Images
• AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?
• Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation
• Hyper-Pairing Network for Multi-Phase Pancreatic Ductal Adenocarcinoma Segmentation
• IODeep: an IOD for the introduction of deep learning in the DICOM standard
• DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets
• Uncertainty-Aware Segmentation Quality Prediction via Deep Learning Bayesian Modeling: Comprehensive Evaluation and Interpretation on Skin Cancer and Liver Segmentation
• A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentation
• Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstraction
• Deep Distance Transform for Tubular Structure Segmentation in CT Scans
• Uncertainty-based graph convolutional networks for organ segmentation refinement
• Marginal loss and exclusion loss for partially supervised multi-organ segmentation
• Local block-wise self attention for normal organ segmentation
• Training CNN Classifiers for Semantic Segmentation using Partially Annotated Images: with Application on Human Thigh and Calf MRI
• A lateral semicircular canal segmentation based geometric calibration for human temporal bone CT Image
• Multi-phase Deformable Registration for Time-dependent Abdominal Organ Variations
• Computational Anatomy for Multi-Organ Analysis in Medical Imaging: A Review