Multi-task pre-training of deep neural networks for digital pathology

Abstract

In this work, we investigate multi-task learning as a way of pre-training models for classification tasks in digital pathology. It is motivated by the fact that many small and medium-size datasets have been released by the community over the years whereas there is no large scale dataset similar to ImageNet in the domain. We first assemble and transform many digital pathology datasets into a pool of 22 classification tasks and almost 900k images. Then, we propose a simple architecture and training scheme for creating a transferable model and a robust evaluation and selection protocol in order to evaluate our method. Depending on the target task, we show that our models used as feature extractors either improve significantly over ImageNet pre-trained models or provide comparable performance. Fine-tuning improves performance over feature extraction and is able to recover the lack of specificity of ImageNet features, as both pre-training sources yield comparable performance.

arXiv commentAccepted for publication in the IEEE Journal of Biomedical and Health Informatics, special issue on Computational Pathology

References in corpus (6)

• A Survey on Deep Learning in Medical Image Analysis
• Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
• Machine learning methods for histopathological image analysis
• BACH: Grand Challenge on Breast Cancer Histology Images
• Predicting breast tumor proliferation from whole-slide images: the TUPAC16 challenge
• Improving Prostate Cancer Detection with Breast Histopathology Images

Cited by in corpus (4)

• FMDNN: A Fuzzy-guided Multi-granular Deep Neural Network for Histopathological Image Classification
• Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for Histopathology Images
• Glioma subtype classification from histopathological images using in-domain and out-of-domain transfer learning: An experimental study
• Tissue Concepts: supervised foundation models in computational pathology