Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound

Abstract

Automatic prostate segmentation in transrectal ultrasound (TRUS) images is of essential importance for image-guided prostate interventions and treatment planning. However, developing such automatic solutions remains very challenging due to the missing/ambiguous boundary and inhomogeneous intensity distribution of the prostate in TRUS, as well as the large variability in prostate shapes. This paper develops a novel 3D deep neural network equipped with attention modules for better prostate segmentation in TRUS by fully exploiting the complementary information encoded in different layers of the convolutional neural network (CNN). Our attention module utilizes the attention mechanism to selectively leverage the multilevel features integrated from different layers to refine the features at each individual layer, suppressing the non-prostate noise at shallow layers of the CNN and increasing more prostate details into features at deep layers. Experimental results on challenging 3D TRUS volumes show that our method attains satisfactory segmentation performance. The proposed attention mechanism is a general strategy to aggregate multi-level deep features and has the potential to be used for other medical image segmentation tasks. The code is publicly available at https://github.com/wulalago/DAF3D.

11 pages, 10 figures, 2 tables. Accepted by IEEE transactions on Medical Imaging

References in corpus (2)

• Deep Learning in Neural Networks: An Overview
• Brain Tumor Segmentation with Deep Neural Networks

Cited by in corpus (10)

• AAU-net: An Adaptive Attention U-net for Breast Lesions Segmentation in Ultrasound Images
• MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Data
• Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation
• Bi-directional Dermoscopic Feature Learning and Multi-scale Consistent Decision Fusion for Skin Lesion Segmentation
• MicroSegNet: A Deep Learning Approach for Prostate Segmentation on Micro-Ultrasound Images
• IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound
• External Attention Assisted Multi-Phase Splenic Vascular Injury Segmentation with Limited Data
• Investigating Shift-Variance of Convolutional Neural Networks in Ultrasound Image Segmentation
• Decoupled Pyramid Correlation Network for Liver Tumor Segmentation from CT images
• The use of deep learning in interventional radiotherapy (brachytherapy): a review with a focus on open source and open data