A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers

Abstract

To increase the objectivity and accuracy of pathologists' work, artificial neural network(ANN) methods have been generally needed in the segmentation, classification, and detection of histopathological WSI. In this paper, WSI analysis methods based on ANN are reviewed. Firstly, the development status of WSI and ANN methods is introduced. Secondly, we summarize the common ANN methods. Next, we discuss publicly available WSI datasets and evaluation metrics. These ANN architectures for WSI processing are divided into classical neural networks and deep neural networks(DNNs) and then analyzed. Finally, the application prospect of the analytical method in this field is discussed. The important potential method is Visual Transformers.

arXiv comment22 pages, 38 figures. arXiv admin note: substantial text overlap with arXiv:2102.10553

References in corpus (28)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Neural Machine Translation by Jointly Learning to Align and Translate
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• A Survey on Visual Transformer
• Machine learning methods for histopathological image analysis
• An Introduction to Convolutional Neural Networks
• Deep Learning for Identifying Metastatic Breast Cancer
• Assessment of algorithms for mitosis detection in breast cancer histopathology images
• Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
• Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks
• A Comprehensive Review for Breast Histopathology Image Analysis Using Classical and Deep Neural Networks
• RMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification
• CAGNet: Content-Aware Guidance for Salient Object Detection
• Multi-scale fully convolutional neural networks for histopathology image segmentation: from nuclear aberrations to the global tissue architecture
• Whole-Slide Image Focus Quality: Automatic Assessment and Impact on AI Cancer Detection
• Classification and Disease Localization in Histopathology Using Only Global Labels: A Weakly-Supervised Approach
• Spatial Transformer Networks
• Gastric histopathology image segmentation using a hierarchical conditional random field
• Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology
• An attention-based multi-resolution model for prostate whole slide imageclassification and localization
• MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
• Automatic labeling of molecular biomarkers of whole slide immunohistochemistry images using fully convolutional networks
• Reinforced Auto-Zoom Net: Towards Accurate and Fast Breast Cancer Segmentation in Whole-slide Images
• CORAL8: Concurrent Object Regression for Area Localization in Medical Image Panels
• Feature based Sequential Classifier with Attention Mechanism
• A deep learning based multiscale approach to segment cancer area in liver whole slide image