Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning

Abstract

Fourier ptychographic microscopy (FPM) is a computational approach geared towards creating high-resolution and large field-of-view images without mechanical scanning. To acquire color images of histology slides, it often requires sequential acquisitions with red, green, and blue illuminations. The color reconstructions often suffer from coherent artifacts that are not presented in regular incoherent microscopy images. As a result, it remains a challenge to employ FPM for digital pathology applications, where resolution and color accuracy are of critical importance. Here we report a deep learning approach for performing unsupervised image-to-image translation of FPM reconstructions. A cycle-consistent adversarial network with multiscale structure similarity loss is trained to perform virtual brightfield and fluorescence staining of the recovered FPM images. In the training stage, we feed the network with two sets of unpaired images: 1) monochromatic FPM recovery, and 2) color or fluorescence images captured using a regular microscope. In the inference stage, the network takes the FPM input and outputs a virtually stained image with reduced coherent artifacts and improved image quality. We test the approach on various samples with different staining protocols. High-quality color and fluorescence reconstructions validate its effectiveness.

References in corpus (6)

• Wide-field, high-resolution Fourier ptychographic microscopy
• Probing 10 μK stability and residual drifts in the cross-polarized dual-mode stabilization of single-crystal ultrahigh-Q optical resonators
• Wide-field, high-resolution lensless on-chip microscopy via near-field blind ptychographic modulation
• Full-field Fourier ptychography (FFP): spatially varying pupil modeling and its application for rapid field-dependent aberration metrology
• OpenWSI: a low-cost, high-throughput whole slide imaging system via single-frame autofocusing and open-source hardware
• Super-resolved multispectral lensless microscopy via angle-tilted, wavelength-multiplexed ptychographic modulation

Cited by in corpus (4)

• On the use of deep learning for phase recovery
• Resolution-enhanced parallel coded ptychography for high-throughput optical imaging
• Digital staining in optical microscopy using deep learning -- a review
• High-throughput lensless whole slide imaging via continuous height-varying modulation of tilted sensor