Extracting quantitative biological information from brightfield cell images using deep learning

Abstract

Quantitative analysis of cell structures is essential for biomedical and pharmaceutical research. The standard imaging approach relies on fluorescence microscopy, where cell structures of interest are labeled by chemical staining techniques. However, these techniques are often invasive and sometimes even toxic to the cells, in addition to being time-consuming, labor-intensive, and expensive. Here, we introduce an alternative deep-learning-powered approach based on the analysis of brightfield images by a conditional generative adversarial neural network (cGAN). We show that this approach can extract information from the brightfield images to generate virtually-stained images, which can be used in subsequent downstream quantitative analyses of cell structures. Specifically, we train a cGAN to virtually stain lipid droplets, cytoplasm, and nuclei using brightfield images of human stem-cell-derived fat cells (adipocytes), which are of particular interest for nanomedicine and vaccine development. Subsequently, we use these virtually-stained images to extract quantitative measures about these cell structures. Generating virtually-stained fluorescence images is less invasive, less expensive, and more reproducible than standard chemical staining; furthermore, it frees up the fluorescence microscopy channels for other analytical probes, thus increasing the amount of information that can be extracted from each cell.

arXiv comment12 pages, 4 figures

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• Conditional Generative Adversarial Nets
• Empirical Evaluation of Rectified Activations in Convolutional Network
• Deep learning-based virtual histology staining using auto-fluorescence of label-free tissue
• PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning
• Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• Phase Imaging with Computational Specificity (PICS) for measuring dry mass changes in sub-cellular compartments
• Cross-modality deep learning brings bright-field microscopy contrast to holography
• Quantitative Digital Microscopy with Deep Learning
• HoloStain: Holographic virtual staining of individual biological cells
• StarGAN v2: Diverse Image Synthesis for Multiple Domains
• Machine-learning techniques for fast and accurate feature localization in holograms of colloidal particles