Integrating uncertainty in deep neural networks for MRI based stroke analysis

Abstract

At present, the majority of the proposed Deep Learning (DL) methods provide point predictions without quantifying the models uncertainty. However, a quantification of the reliability of automated image analysis is essential, in particular in medicine when physicians rely on the results for making critical treatment decisions. In this work, we provide an entire framework to diagnose ischemic stroke patients incorporating Bayesian uncertainty into the analysis procedure. We present a Bayesian Convolutional Neural Network (CNN) yielding a probability for a stroke lesion on 2D Magnetic Resonance (MR) images with corresponding uncertainty information about the reliability of the prediction. For patient-level diagnoses, different aggregation methods are proposed and evaluated, which combine the single image-level predictions. Those methods take advantage of the uncertainty in image predictions and report model uncertainty at the patient-level. In a cohort of 511 patients, our Bayesian CNN achieved an accuracy of 95.33% at the image-level representing a significant improvement of 2% over a non-Bayesian counterpart. The best patient aggregation method yielded 95.89% of accuracy. Integrating uncertainty information about image predictions in aggregation models resulted in higher uncertainty measures to false patient classifications, which enabled to filter critical patient diagnoses that are supposed to be closer examined by a medical doctor. We therefore recommend using Bayesian approaches not only for improved image-level prediction and uncertainty estimation but also for the detection of uncertain aggregations at the patient-level.

arXiv comment21 pages, 13 figures

References in corpus (12)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Brain Tumor Segmentation with Deep Neural Networks
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
• Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks
• Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks
• Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review
• Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
• An Ensemble of Deep Convolutional Neural Networks for Alzheimer's Disease Detection and Classification
• Propagating Uncertainty in Multi-Stage Bayesian Convolutional Neural Networks with Application to Pulmonary Nodule Detection

Cited by in corpus (5)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imaging
• High-resolution neural network-driven mapping of multiple diffusion metrics leveraging asymmetries in the balanced SSFP frequency profile
• Uncertainty categories in medical image segmentation: a study of source-related diversity
• Uncertainty-Based Biological Age Estimation of Brain MRI Scans