Noise-robust latent vector reconstruction in ptychography using deep generative models

Abstract

Computational imaging is increasingly vital for a broad spectrum of applications, ranging from biological to material sciences. This includes applications where the object is known and sufficiently sparse, allowing it to be described with a reduced number of parameters. When no explicit parameterization is available, a deep generative model can be trained to represent an object in a low-dimensional latent space. In this paper, we harness this dimensionality reduction capability of autoencoders to search for the object solution within the latent space rather than the object space. We demonstrate a novel approach to ptychographic image reconstruction by integrating a deep generative model obtained from a pre-trained autoencoder within an Automatic Differentiation Ptychography (ADP) framework. This approach enables the retrieval of objects from highly ill-posed diffraction patterns, offering an effective method for noise-robust latent vector reconstruction in ptychography. Moreover, the mapping into a low-dimensional latent space allows us to visualize the optimization landscape, which provides insight into the convexity and convergence behavior of the inverse problem. With this work, we aim to facilitate new applications for sparse computational imaging such as when low radiation doses or rapid reconstructions are essential.

References in corpus (21)

• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Wide-field, high-resolution Fourier ptychographic microscopy
• Deep Image Prior
• Low Photon Count Phase Retrieval Using Deep Learning
• Efficient and accurate inversion of multiple scattering with deep learning
• Real-time coherent diffraction inversion using deep generative networks
• Using Automatic Differentiation as a General Framework for Ptychographic Reconstruction
• Implicit Regularization in Deep Matrix Factorization
• Overcoming information reduced data and experimentally uncertain parameters in ptychography with regularized optimization
• PtyLab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and Fourier ptychography
• Three dimensions, two microscopes, one code: automatic differentiation for x-ray nanotomography beyond the depth of focus limit
• Efficient and flexible approach to ptychography using an optimization framework based on automatic differentiation
• Maximum-likelihood estimation in ptychography in the presence of Poisson-Gaussian noise statistics
• SiSPRNet: End-to-End Learning for Single-Shot Phase Retrieval
• Generative adversarial network for super-resolution imaging through a fiber
• The CRLB and Maximum likelihood in ptychography with Poisson noise
• Optimizing illumination for precise multi-parameter estimations in coherent diffractive imaging
• Using a modified double deep image prior for crosstalk mitigation in multislice ptychography
• Sensor fusion in ptychography