Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification

Abstract

This paper considers the task of thorax disease classification on chest X-ray images. Existing methods generally use the global image as input for network learning. Such a strategy is limited in two aspects. 1) A thorax disease usually happens in (small) localized areas which are disease specific. Training CNNs using global image may be affected by the (excessive) irrelevant noisy areas. 2) Due to the poor alignment of some CXR images, the existence of irregular borders hinders the network performance. In this paper, we address the above problems by proposing a three-branch attention guided convolution neural network (AG-CNN). AG-CNN 1) learns from disease-specific regions to avoid noise and improve alignment, 2) also integrates a global branch to compensate the lost discriminative cues by local branch. Specifically, we first learn a global CNN branch using global images. Then, guided by the attention heat map generated from the global branch, we inference a mask to crop a discriminative region from the global image. The local region is used for training a local CNN branch. Lastly, we concatenate the last pooling layers of both the global and local branches for fine-tuning the fusion branch. The Comprehensive experiment is conducted on the ChestX-ray14 dataset. We first report a strong global baseline producing an average AUC of 0.841 with ResNet-50 as backbone. After combining the local cues with the global information, AG-CNN improves the average AUC to 0.868. While DenseNet-121 is used, the average AUC achieves 0.871, which is a new state of the art in the community.

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• A Survey on Deep Learning in Medical Image Analysis
• Densely Connected Convolutional Networks
• CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
• Learning to diagnose from scratch by exploiting dependencies among labels
• DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation
• Learning to detect chest radiographs containing lung nodules using visual attention networks
• Abnormality Detection and Localization in Chest X-Rays using Deep Convolutional Neural Networks
• Learning what to look in chest X-rays with a recurrent visual attention model
• Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation

Cited by in corpus (35)

• A Survey on Visual Transformer
• Attention Mechanisms in Computer Vision: A Survey
• Recent advances and clinical applications of deep learning in medical image analysis
• Medical Image Segmentation Using Deep Learning: A Survey
• PadChest: A large chest x-ray image dataset with multi-label annotated reports
• A Survey on Incorporating Domain Knowledge into Deep Learning for Medical Image Analysis
• Learning Hierarchical Attention for Weakly-supervised Chest X-Ray Abnormality Localization and Diagnosis
• Weakly Supervised Deep Learning for Thoracic Disease Classification and Localization on Chest X-rays
• Semi-supervised Credit Card Fraud Detection via Attribute-Driven Graph Representation
• An Attention-Guided Deep Regression Model for Landmark Detection in Cephalograms
• Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes
• Weakly Supervised Medical Diagnosis and Localization from Multiple Resolutions
• Large Scale Automated Reading of Frontal and Lateral Chest X-Rays using Dual Convolutional Neural Networks
• Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
• Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels
• An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization
• Automatic Diagnosis of Pneumothorax from Chest Radiographs: A Systematic Literature Review
• Automatic Diagnosis of Pulmonary Embolism Using an Attention-guided Framework: A Large-scale Study
• Deep Learning with Attention to Predict Gestational Age of the Fetal Brain
• Multi-Label Generalized Zero Shot Learning for the Classification of Disease in Chest Radiographs
• Local Adaptation Improves Accuracy of Deep Learning Model for Automated X-Ray Thoracic Disease Detection : A Thai Study
• Bias Field Poses a Threat to DNN-based X-Ray Recognition
• Multi-label Ranking: Mining Multi-label and Label Ranking Data
• Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization
• Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning
• Attention-Guided Discriminative Region Localization and Label Distribution Learning for Bone Age Assessment
• Extracting and Leveraging Nodule Features with Lung Inpainting for Local Feature Augmentation
• A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentation
• Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning
• Dynamic Graph Correlation Learning for Disease Diagnosis with Incomplete Labels
• Deep Hiearchical Multi-Label Classification Applied to Chest X-Ray Abnormality Taxonomies
• Cross Chest Graph for Disease Diagnosis with Structural Relational Reasoning
• Attention-guided Quality Assessment for Automated Cryo-EM Grid Screening
• Classification of COVID-19 from CXR Images in a 15-class Scenario: an Attempt to Avoid Bias in the System
• A distillation based approach for the diagnosis of diseases