Deep Learning Enables Automatic Detection and Segmentation of Brain Metastases on Multi-Sequence MRI

Abstract

Detecting and segmenting brain metastases is a tedious and time-consuming task for many radiologists, particularly with the growing use of multi-sequence 3D imaging. This study demonstrates automated detection and segmentation of brain metastases on multi-sequence MRI using a deep learning approach based on a fully convolution neural network (CNN). In this retrospective study, a total of 156 patients with brain metastases from several primary cancers were included. Pre-therapy MR images (1.5T and 3T) included pre- and post-gadolinium T1-weighted 3D fast spin echo, post-gadolinium T1-weighted 3D axial IR-prepped FSPGR, and 3D fluid attenuated inversion recovery. The ground truth was established by manual delineation by two experienced neuroradiologists. CNN training/development was performed using 100 and 5 patients, respectively, with a 2.5D network based on a GoogLeNet architecture. The results were evaluated in 51 patients, equally separated into those with few (1-3), multiple (4-10), and many (>10) lesions. Network performance was evaluated using precision, recall, Dice/F1 score, and ROC-curve statistics. For an optimal probability threshold, detection and segmentation performance was assessed on a per metastasis basis. The area under the ROC-curve (AUC), averaged across all patients, was 0.98. The AUC in the subgroups was 0.99, 0.97, and 0.97 for patients having 1-3, 4-10, and >10 metastases, respectively. Using an average optimal probability threshold determined by the development set, precision, recall, and Dice-score were 0.79, 0.53, and 0.79, respectively. At the same probability threshold, the network showed an average false positive rate of 8.3/patient (no lesion-size limit) and 3.4/patient (10 mm3 lesion size limit). In conclusion, a deep learning approach using multi-sequence MRI can aid in the detection and segmentation of brain metastases.

References in corpus (8)

• Adam: A Method for Stochastic Optimization
• Deep Residual Learning for Image Recognition
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Densely Connected Convolutional Networks
• Going Deeper with Convolutions
• A deep learning model integrating FCNNs and CRFs for brain tumor segmentation
• Feature Pyramid Networks for Object Detection
• Pyramid Scene Parsing Network

Cited by in corpus (12)

• Deep learning for brain metastasis detection and segmentation in longitudinal MRI data
• Preoperative brain tumor imaging: models and software for segmentation and standardized reporting
• The University of California San Francisco Brain Metastases Stereotactic Radiosurgery (UCSF-BMSR) MRI Dataset
• Multicenter Privacy-Preserving Model Training for Deep Learning Brain Metastases Autosegmentation
• Exploring the Capabilities and Limitations of Large Language Models for Radiation Oncology Decision Support
• Constrained Generative Adversarial Network Ensembles for Sharable Synthetic Data Generation
• Pre-examinations Improve Automated Metastases Detection on Cranial MRI
• MRI Pulse Sequence Integration for Deep-Learning Based Brain Metastasis Segmentation
• Random Bundle: Brain Metastases Segmentation Ensembling through Annotation Randomization
• Handling Missing MRI Input Data in Deep Learning Segmentation of Brain Metastases: A Multi-Center Study
• The Missing Piece: A Case for Pre-Training in 3D Medical Object Detection
• Brain Metastasis Segmentation Network Trained with Robustness to Annotations with Multiple False Negatives