Advancing diagnostic performance and clinical usability of neural networks via adversarial training and dual batch normalization

Abstract

Unmasking the decision-making process of machine learning models is essential for implementing diagnostic support systems in clinical practice. Here, we demonstrate that adversarially trained models can significantly enhance the usability of pathology detection as compared to their standard counterparts. We let six experienced radiologists rate the interpretability of saliency maps in datasets of X-rays, computed tomography, and magnetic resonance imaging scans. Significant improvements were found for our adversarial models, which could be further improved by the application of dual batch normalization. Contrary to previous research on adversarially trained models, we found that the accuracy of such models was equal to standard models when sufficiently large datasets and dual batch norm training were used. To ensure transferability, we additionally validated our results on an external test set of 22,433 X-rays. These findings elucidate that different paths for adversarial and real images are needed during training to achieve state of the art results with superior clinical interpretability.

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Explaining and Harnessing Adversarial Examples
• ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases
• One pixel attack for fooling deep neural networks
• Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge
• CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
• Theoretically Principled Trade-off between Robustness and Accuracy
• Similarity of Neural Network Representations Revisited
• Adversarial Examples Are Not Bugs, They Are Features
• Robustness May Be at Odds with Accuracy
• Once-for-All Adversarial Training: In-Situ Tradeoff between Robustness and Accuracy for Free

Cited by in corpus (2)

• Survey on Adversarial Attack and Defense for Medical Image Analysis: Methods and Challenges
• Quantifying the Preferential Direction of the Model Gradient in Adversarial Training With Projected Gradient Descent