A novel framework employing deep multi-attention channels network for the autonomous detection of metastasizing cells through fluorescence microscopy
arXiv:2309.00911 · doi:10.1016/j.compbiomed.2024.109052
Abstract
We developed a transparent computational large-scale imaging-based framework that can distinguish between normal and metastasizing human cells. The method relies on fluorescence microscopy images showing the spatial organization of actin and vimentin filaments in normal and metastasizing single cells, using a combination of multi-attention channels network and global explainable techniques. We test a classification between normal cells (Bj primary fibroblast), and their isogenically matched, transformed and invasive counterpart (BjTertSV40TRasV12). Manual annotation is not trivial to automate due to the intricacy of the biologically relevant features. In this research, we utilized established deep learning networks and our new multi-attention channel architecture. To increase the interpretability of the network - crucial for this application area - we developed an interpretable global explainable approach correlating the weighted geometric mean of the total cell images and their local GradCam scores. The significant results from our analysis unprecedently allowed a more detailed, and biologically relevant understanding of the cytoskeletal changes that accompany oncogenic transformation of normal to invasive and metastasizing cells. We also paved the way for a possible spatial micrometre-level biomarker for future development of diagnostic tools against metastasis (spatial distribution of vimentin).
References in corpus (9)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
- Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
- Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
- Deep Visual Attention Prediction
- Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysis
- ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis
- Explainable AI: current status and future directions