An overview of deep learning in medical imaging focusing on MRI

Abstract

What has happened in machine learning lately, and what does it mean for the future of medical image analysis? Machine learning has witnessed a tremendous amount of attention over the last few years. The current boom started around 2009 when so-called deep artificial neural networks began outperforming other established models on a number of important benchmarks. Deep neural networks are now the state-of-the-art machine learning models across a variety of areas, from image analysis to natural language processing, and widely deployed in academia and industry. These developments have a huge potential for medical imaging technology, medical data analysis, medical diagnostics and healthcare in general, slowly being realized. We provide a short overview of recent advances and some associated challenges in machine learning applied to medical image processing and image analysis. As this has become a very broad and fast expanding field we will not survey the entire landscape of applications, but put particular focus on deep learning in MRI. Our aim is threefold: (i) give a brief introduction to deep learning with pointers to core references; (ii) indicate how deep learning has been applied to the entire MRI processing chain, from acquisition to image retrieval, from segmentation to disease prediction; (iii) provide a starting point for people interested in experimenting and perhaps contributing to the field of machine learning for medical imaging by pointing out good educational resources, state-of-the-art open-source code, and interesting sources of data and problems related medical imaging.

Minor updates. Close to the version published in Zeitschrift für Medizinische Physik (Available online 13 December 2018)

References in corpus (30)

• A Survey on Deep Learning in Medical Image Analysis
• Generative Adversarial Networks: An Overview
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Brain Tumor Segmentation with Deep Neural Networks
• Scalable and accurate deep learning for electronic health records
• DeepSurv: Personalized Treatment Recommender System Using A Cox Proportional Hazards Deep Neural Network
• Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learning
• Image reconstruction by domain transform manifold learning
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Confounding variables can degrade generalization performance of radiological deep learning models
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
• TractSeg - Fast and accurate white matter tract segmentation
• Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method
• A Review of Convolutional Neural Networks for Inverse Problems in Imaging
• An Unsupervised Learning Model for Deformable Medical Image Registration
• NiftyNet: a deep-learning platform for medical imaging
• Medical Image Retrieval using Deep Convolutional Neural Network
• On the Automatic Generation of Medical Imaging Reports
• Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
• MR fingerprinting Deep RecOnstruction NEtwork (DRONE)
• Neural Network with Unbounded Activation Functions is Universal Approximator
• Deep Learning in Pharmacogenomics: From Gene Regulation to Patient Stratification
• Slice-to-volume medical image registration: a survey
• Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
• Glitch Classification and Clustering for LIGO with Deep Transfer Learning
• Learning Implicit Brain MRI Manifolds with Deep Learning
• Learning Deep Similarity Metric for 3D MR-TRUS Registration
• Learning Data Augmentation for Brain Tumor Segmentation with Coarse-to-Fine Generative Adversarial Networks
• Prospects for Theranostics in Neurosurgical Imaging: Empowering Confocal Laser Endomicroscopy Diagnostics via Deep Learning

Cited by in corpus (50)

• Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluation
• Artificial Intelligence in the Creative Industries: A Review
• A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
• Deep learning in nano-photonics: inverse design and beyond
• Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
• The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study
• Hybrid quantum convolutional neural networks model for COVID-19 prediction using chest X-Ray images
• Evaluation of machine learning algorithms for Health and Wellness applications: a tutorial
• RA-GCN: Graph Convolutional Network for Disease Prediction Problems with Imbalanced Data
• Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
• Promises and pitfalls of deep neural networks in neuroimaging-based psychiatric research
• A Transfer Learning Evaluation of Deep Neural Networks for Image Classification
• Decision and Feature Level Fusion of Deep Features Extracted from Public COVID-19 Data-sets
• pymia: A Python package for data handling and evaluation in deep learning-based medical image analysis
• KomaMRI.jl: An Open-Source Framework for General MRI Simulations with GPU Acceleration
• Application of artificial intelligence techniques for automated detection of myocardial infarction: A review
• Multimodal and multicontrast image fusion via deep generative models
• Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI
• Large-Scale Analysis of Iliopsoas Muscle Volumes in the UK Biobank
• sMRI-PatchNet: A novel explainable patch-based deep learning network for Alzheimer's disease diagnosis and discriminative atrophy localisation with Structural MRI
• Deep Learning based Multi-modal Computing with Feature Disentanglement for MRI Image Synthesis
• Improving needle visibility in LED-based photoacoustic imaging using deep learning with semi-synthetic datasets
• LAI-Net: Local-Ancestry Inference with Neural Networks
• Optimized Three Deep Learning Models Based-PSO Hyperparameters for Beijing PM2.5 Prediction
• Generalizable multi-task, multi-domain deep segmentation of sparse pediatric imaging datasets via multi-scale contrastive regularization and multi-joint anatomical priors
• Guided Reconstruction with Conditioned Diffusion Models for Unsupervised Anomaly Detection in Brain MRIs
• Application of Deep Learning in Generating Structured Radiology Reports: A Transformer-Based Technique
• Latent Similarity Identifies Important Functional Connections for Phenotype Prediction
• Benchmarking the performance of a low-cost Magnetic Resonance Control System at multiple sites in the open MaRCoS community
• Generalizable synthetic MRI with physics-informed convolutional networks
• Deep Learning for Ultrasound Speed-of-Sound Reconstruction: Impacts of Training Data Diversity on Stability and Robustness
• Automatic Diagnosis of Pneumothorax from Chest Radiographs: A Systematic Literature Review
• Bounding Information Leakage in Machine Learning
• 3D Brain and Heart Volume Generative Models: A Survey
• TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs
• Fine-tuning ERNIE for chest abnormal imaging signs extraction
• NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems
• Discriminative Hamiltonian Variational Autoencoder for Accurate Tumor Segmentation in Data-Scarce Regimes
• Effective Shortcut Technique for GAN
• Multivariate analysis of Brillouin imaging data by supervised and unsupervised learning
• End-to-end autoencoding architecture for the simultaneous generation of medical images and corresponding segmentation masks
• Fine-grained Anomaly Detection via Multi-task Self-Supervision
• Enhancing quality and speed in database-free neural network reconstructions of undersampled MRI with SCAMPI
• MRAnnotator: multi-Anatomy and many-Sequence MRI segmentation of 44 structures
• Deep Learning: a Heuristic Three-stage Mechanism for Grid Searches to Optimize the Future Risk Prediction of Breast Cancer Metastasis Using EHR-based Clinical Data
• On the Feasibility of Deep Learning Classification from Raw Signal Data in Radiology, Ultrasonography and Electrophysiology
• Multi-Task, Multi-Domain Deep Segmentation with Shared Representations and Contrastive Regularization for Sparse Pediatric Datasets
• Deep Learning -- A first Meta-Survey of selected Reviews across Scientific Disciplines, their Commonalities, Challenges and Research Impact
• Vessel-CAPTCHA: an efficient learning framework for vessel annotation and segmentation
• Cosmic velocity, density and halo mass function: Insights from deep learning