Transfer Learning in Magnetic Resonance Brain Imaging: a Systematic Review

Abstract

Transfer learning refers to machine learning techniques that focus on acquiring knowledge from related tasks to improve generalization in the tasks of interest. In MRI, transfer learning is important for developing strategies that address the variation in MR images. Additionally, transfer learning is beneficial to re-utilize machine learning models that were trained to solve related tasks to the task of interest. Our goal is to identify research directions, gaps of knowledge, applications, and widely used strategies among the transfer learning approaches applied in MR brain imaging. We performed a systematic literature search for articles that applied transfer learning to MR brain imaging. We screened 433 studies and we categorized and extracted relevant information, including task type, application, and machine learning methods. Furthermore, we closely examined brain MRI-specific transfer learning approaches and other methods that tackled privacy, unseen target domains, and unlabeled data. We found 129 articles that applied transfer learning to brain MRI tasks. The most frequent applications were dementia related classification tasks and brain tumor segmentation. A majority of articles utilized transfer learning on convolutional neural networks (CNNs). Only few approaches were clearly brain MRI specific, considered privacy issues, unseen target domains or unlabeled data. We proposed a new categorization to group specific, widely-used approaches. There is an increasing interest in transfer learning within brain MRI. Public datasets have contributed to the popularity of Alzheimer's diagnostics/prognostics and tumor segmentation. Likewise, the availability of pretrained CNNs has promoted their utilization. Finally, the majority of the surveyed studies did not examine in detail the interpretation of their strategies after applying transfer learning, and did not compare to other approaches.

Accepted in Journal of Imaging

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Automatic Assessment of Alzheimer's Disease Diagnosis Based on Deep Learning Techniques
• DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images
• Data augmentation using learned transformations for one-shot medical image segmentation
• An Inductive Transfer Learning Approach using Cycle-consistent Adversarial Domain Adaptation with Application to Brain Tumor Segmentation
• Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to Unseen Domains
• Revisiting Rubik's Cube: Self-supervised Learning with Volume-wise Transformation for 3D Medical Image Segmentation
• Self domain adapted network
• Training Data Independent Image Registration With GANs Using Transfer Learning And Segmentation Information

Cited by in corpus (1)

• Fast Whole-Brain MR Multi-Parametric Mapping with Scan-Specific Self-Supervised Networks