A Survey on Deep Learning of Small Sample in Biomedical Image Analysis

Abstract

The success of deep learning has been witnessed as a promising technique for computer-aided biomedical image analysis, due to end-to-end learning framework and availability of large-scale labelled samples. However, in many cases of biomedical image analysis, deep learning techniques suffer from the small sample learning (SSL) dilemma caused mainly by lack of annotations. To be more practical for biomedical image analysis, in this paper we survey the key SSL techniques that help relieve the suffering of deep learning by combining with the development of related techniques in computer vision applications. In order to accelerate the clinical usage of biomedical image analysis based on deep learning techniques, we intentionally expand this survey to include the explanation methods for deep models that are important to clinical decision making. We survey the key SSL techniques by dividing them into five categories: (1) explanation techniques, (2) weakly supervised learning techniques, (3) transfer learning techniques, (4) active learning techniques, and (5) miscellaneous techniques involving data augmentation, domain knowledge, traditional shallow methods and attention mechanism. These key techniques are expected to effectively support the application of deep learning in clinical biomedical image analysis, and furtherly improve the analysis performance, especially when large-scale annotated samples are not available. We bulid demos at https://github.com/PengyiZhang/MIADeepSSL.

References in corpus (21)

• A Survey on Deep Learning in Medical Image Analysis
• Attention U-Net: Learning Where to Look for the Pancreas
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
• Learning Transferable Features with Deep Adaptation Networks
• Generative Adversarial Network in Medical Imaging: A Review
• Understanding Neural Networks Through Deep Visualization
• Active Learning for Convolutional Neural Networks: A Core-Set Approach
• Cost-Effective Active Learning for Deep Image Classification
• Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
• Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities
• Constrained-CNN losses for weakly supervised segmentation
• ChestNet: A Deep Neural Network for Classification of Thoracic Diseases on Chest Radiography
• Angle-Closure Detection in Anterior Segment OCT based on Multi-Level Deep Network
• Cost-Effective Active Learning for Melanoma Segmentation
• Small Sample Learning in Big Data Era
• Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation
• BoxNet: Deep Learning Based Biomedical Image Segmentation Using Boxes Only Annotation
• Active Learning for Segmentation by Optimizing Content Information for Maximal Entropy
• Adversarial training and dilated convolutions for brain MRI segmentation
• Learning to Segment Medical Images with Scribble-Supervision Alone

Cited by in corpus (5)

• Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
• Deep-Learning-Based Image Segmentation Integrated with Optical Microscopy for Automatically Searching for Two-Dimensional Materials
• Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models
• Convolutional Neural Networks from Image Markers
• Toward High-Throughput Artificial Intelligence-Based Segmentation in Oncological PET Imaging