Attention Enriched Deep Learning Model for Breast Tumor Segmentation in Ultrasound Images

Abstract

Incorporating human domain knowledge for breast tumor diagnosis is challenging, since shape, boundary, curvature, intensity, or other common medical priors vary significantly across patients and cannot be employed. This work proposes a new approach for integrating visual saliency into a deep learning model for breast tumor segmentation in ultrasound images. Visual saliency refers to image maps containing regions that are more likely to attract radiologists visual attention. The proposed approach introduces attention blocks into a U-Net architecture, and learns feature representations that prioritize spatial regions with high saliency levels. The validation results demonstrate increased accuracy for tumor segmentation relative to models without salient attention layers. The approach achieved a Dice similarity coefficient of 90.5 percent on a dataset of 510 images. The salient attention model has potential to enhance accuracy and robustness in processing medical images of other organs, by providing a means to incorporate task-specific knowledge into deep learning architectures.

16 pages, 5 figures

References in corpus (17)

• A Survey on Deep Learning in Medical Image Analysis
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Deep Residual Learning for Image Recognition
• Attention U-Net: Learning Where to Look for the Pancreas
• Brain Tumor Segmentation with Deep Neural Networks
• Recurrent Models of Visual Attention
• Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentation
• AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy
• Deep Networks with Internal Selective Attention through Feedback Connections
• Retina U-Net: Embarrassingly Simple Exploitation of Segmentation Supervision for Medical Object Detection
• Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening
• Incorporating the Knowledge of Dermatologists to Convolutional Neural Networks for the Diagnosis of Skin Lesions
• Incorporating prior knowledge in medical image segmentation: a survey
• Neutro-Connectedness Cut
• Automated soft tissue lesion detection and segmentation in digital mammography using a u-net deep learning network
• Supervised Uncertainty Quantification for Segmentation with Multiple Annotations
• Tumor Saliency Estimation for Breast Ultrasound Images via Breast Anatomy Modeling

Cited by in corpus (3)

• Recent Progress in Transformer-based Medical Image Analysis
• Saliency-Guided Deep Learning Network for Automatic Tumor Bed Volume Delineation in Post-operative Breast Irradiation
• A Novel Approach to Breast Cancer Segmentation using U-Net Model with Attention Mechanisms and FedProx