An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization

Abstract

Medical images differ from natural images in significantly higher resolutions and smaller regions of interest. Because of these differences, neural network architectures that work well for natural images might not be applicable to medical image analysis. In this work, we extend the globally-aware multiple instance classifier, a framework we proposed to address these unique properties of medical images. This model first uses a low-capacity, yet memory-efficient, network on the whole image to identify the most informative regions. It then applies another higher-capacity network to collect details from chosen regions. Finally, it employs a fusion module that aggregates global and local information to make a final prediction. While existing methods often require lesion segmentation during training, our model is trained with only image-level labels and can generate pixel-level saliency maps indicating possible malignant findings. We apply the model to screening mammography interpretation: predicting the presence or absence of benign and malignant lesions. On the NYU Breast Cancer Screening Dataset, consisting of more than one million images, our model achieves an AUC of 0.93 in classifying breasts with malignant findings, outperforming ResNet-34 and Faster R-CNN. Compared to ResNet-34, our model is 4.1x faster for inference while using 78.4% less GPU memory. Furthermore, we demonstrate, in a reader study, that our model surpasses radiologist-level AUC by a margin of 0.11. The proposed model is available online: https://github.com/nyukat/GMIC.

References in corpus (20)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
• Densely Connected Convolutional Networks
• CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
• An Analysis of Deep Neural Network Models for Practical Applications
• Attention-based Deep Multiple Instance Learning
• Constrained-CNN losses for weakly supervised segmentation
• Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification
• High-Resolution Breast Cancer Screening with Multi-View Deep Convolutional Neural Networks
• Anatomy-specific classification of medical images using deep convolutional nets
• Discriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules
• An Attention-Guided Deep Regression Model for Landmark Detection in Cephalograms
• Weakly Supervised Medical Diagnosis and Localization from Multiple Resolutions
• Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation
• MAMMO: A Deep Learning Solution for Facilitating Radiologist-Machine Collaboration in Breast Cancer Diagnosis
• PseudoEdgeNet: Nuclei Segmentation only with Point Annotations
• Deep Angular Embedding and Feature Correlation Attention for Breast MRI Cancer Analysis
• Deep multiscale convolutional feature learning for weakly supervised localization of chest pathologies in X-ray images

Cited by in corpus (1)

• Reducing false-positive biopsies with deep neural networks that utilize local and global information in screening mammograms