Illumination Pattern Design with Deep Learning for Single-Shot Fourier Ptychographic Microscopy

Abstract

Fourier ptychographic microscopy allows for the collection of images with a high space-bandwidth product at the cost of temporal resolution. In Fourier ptychographic microscopy, the light source of a conventional widefield microscope is replaced with a light-emitting diode (LED) matrix, and multiple images are collected with different LED illumination patterns. From these images, a higher-resolution image can be computationally reconstructed without sacrificing field-of-view. We use deep learning to achieve single-shot imaging without sacrificing the space-bandwidth product, reducing the acquisition time in Fourier ptychographic microscopy by a factor of 69. In our deep learning approach, a training dataset of high-resolution images is used to jointly optimize a single LED illumination pattern with the parameters of a reconstruction algorithm. Our work paves the way for high-throughput imaging in biological studies.

References in corpus (6)

• Wide-field, high-resolution Fourier ptychographic microscopy
• Experimental robustness of Fourier Ptychography phase retrieval algorithms
• Computational illumination for high-speed in vitro Fourier ptychographic microscopy
• Using Machine-Learning to Optimize phase contrast in a Low-Cost Cellphone Microscope
• Convolutional neural networks that teach microscopes how to image
• Optimal Physical Preprocessing for Example-Based Super-Resolution

Cited by in corpus (12)

• On the use of deep learning for phase recovery
• J-MoDL: Joint Model-Based Deep Learning for Optimized Sampling and Reconstruction
• Does deep learning always outperform simple linear regression in optical imaging?
• PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRI
• Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data
• Multi-element microscope optimization by a learned sensing network with composite physical layers
• Integration of Programmable Diffraction with Digital Neural Networks
• HYPPO: A Surrogate-Based Multi-Level Parallelism Tool for Hyperparameter Optimization
• PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy
• Deep Phase Shifter for Quantitative Phase Imaging
• BlurryScope enables compact, cost-effective scanning microscopy for HER2 scoring using deep learning on blurry images
• Deep Learned Optical Multiplexing for Multi-Focal Plane Microscopy