Deep learning in radiology: an overview of the concepts and a survey of the state of the art

Abstract

Deep learning is a branch of artificial intelligence where networks of simple interconnected units are used to extract patterns from data in order to solve complex problems. Deep learning algorithms have shown groundbreaking performance in a variety of sophisticated tasks, especially those related to images. They have often matched or exceeded human performance. Since the medical field of radiology mostly relies on extracting useful information from images, it is a very natural application area for deep learning, and research in this area has rapidly grown in recent years. In this article, we review the clinical reality of radiology and discuss the opportunities for application of deep learning algorithms. We also introduce basic concepts of deep learning including convolutional neural networks. Then, we present a survey of the research in deep learning applied to radiology. We organize the studies by the types of specific tasks that they attempt to solve and review the broad range of utilized deep learning algorithms. Finally, we briefly discuss opportunities and challenges for incorporating deep learning in the radiology practice of the future.

arXiv comment27 pages, 4 figures

References in corpus (19)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• An overview of gradient descent optimization algorithms
• Brain Tumor Segmentation with Deep Neural Networks
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Focal Loss for Dense Object Detection
• CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
• An Analysis of Deep Neural Network Models for Practical Applications
• Improving Computer-aided Detection using Convolutional Neural Networks and Random View Aggregation
• DeepNAT: Deep Convolutional Neural Network for Segmenting Neuroanatomy
• Scalable, High-Quality Object Detection
• Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks
• Improving Deep Pancreas Segmentation in CT and MRI Images via Recurrent Neural Contextual Learning and Direct Loss Function
• Real-Time Automatic Fetal Brain Extraction in Fetal MRI by Deep Learning
• Detecting hip fractures with radiologist-level performance using deep neural networks
• DeepRadiologyNet: Radiologist Level Pathology Detection in CT Head Images
• Deep Learning for identifying radiogenomic associations in breast cancer
• Detection and Attention: Diagnosing Pulmonary Lung Cancer from CT by Imitating Physicians
• Deep learning analysis of breast MRIs for prediction of occult invasive disease in ductal carcinoma in situ

Cited by in corpus (6)

• Visual enhancement of Cone-beam CT by use of CycleGAN
• TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs
• A Strong Baseline for Domain Adaptation and Generalization in Medical Imaging
• Diffusion-Weighted Magnetic Resonance Brain Images Generation with Generative Adversarial Networks and Variational Autoencoders: A Comparison Study
• Deep learning based automatic segmentation of lumbosacral nerves on non-contrast CT for radiographic evaluation: a pilot study
• A survey on deep learning approaches for breast cancer diagnosis