Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation

Abstract

Many material and biological samples in scientific imaging are characterized by non-local repeating structures. These are studied using scanning electron microscopy and electron tomography. Sparse sampling of individual pixels in a 2D image acquisition geometry, or sparse sampling of projection images with large tilt increments in a tomography experiment, can enable high speed data acquisition and minimize sample damage caused by the electron beam. In this paper, we present an algorithm for electron tomographic reconstruction and sparse image interpolation that exploits the non-local redundancy in images. We adapt a framework, termed plug-and-play (P&P) priors, to solve these imaging problems in a regularized inversion setting. The power of the P&P approach is that it allows a wide array of modern denoising algorithms to be used as a "prior model" for tomography and image interpolation. We also present sufficient mathematical conditions that ensure convergence of the P&P approach, and we use these insights to design a new non-local means denoising algorithm. Finally, we demonstrate that the algorithm produces higher quality reconstructions on both simulated and real electron microscope data, along with improved convergence properties compared to other methods.

13 pages, 11 figures

Cited by in corpus (56)

• CNN-Based Projected Gradient Descent for Consistent Image Reconstruction
• Plug and play methods for magnetic resonance imaging (long version)
• Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems
• Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers
• Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging
• An Online Plug-and-Play Algorithm for Regularized Image Reconstruction
• Deep Plug-and-play Prior for Low-rank Tensor Completion
• Class-Aware Fully-Convolutional Gaussian and Poisson Denoising
• Super-Resolution via Image-Adapted Denoising CNNs: Incorporating External and Internal Learning
• Provable Convergence of Plug-and-Play Priors with MMSE denoisers
• SIMBA: Scalable Inversion in Optical Tomography using Deep Denoising Priors
• Convolutional Proximal Neural Networks and Plug-and-Play Algorithms
• Deep Learning for space-variant deconvolution in galaxy surveys
• Back-Projection based Fidelity Term for Ill-Posed Linear Inverse Problems
• Fixed-Point and Objective Convergence of Plug-and-Play Algorithms
• Parseval Proximal Neural Networks
• Unified Single-Image and Video Super-Resolution via Denoising Algorithms
• Plug-and-play ISTA converges with kernel denoisers
• Regularized Fourier Ptychography using an Online Plug-and-Play Algorithm
• On Plug-and-Play Regularization using Linear Denoisers
• SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees
• Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Prior
• PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularization
• Plug-and-Play Quantum Adaptive Denoiser for Deconvolving Poisson Noisy Images
• Graph Signal Restoration Using Nested Deep Algorithm Unrolling
• Multi-Resolution Data Fusion for Super Resolution Imaging
• Learning-based Image Reconstruction via Parallel Proximal Algorithm
• Wasserstein Patch Prior for Image Superresolution
• Convolutional Sparse Representations with Gradient Penalties
• A New Recurrent Plug-and-Play Prior Based on the Multiple Self-Similarity Network
• Learning Convex Regularizers for Optimal Bayesian Denoising
• Restoration by Compression
• On Maximum-a-Posteriori estimation with Plug & Play priors and stochastic gradient descent
• Integrating neural networks into the blind deblurring framework to compete with the end-to-end learning-based methods
• Momentum-Net: Fast and convergent iterative neural network for inverse problems
• On the Proof of Fixed-Point Convergence for Plug-and-Play ADMM
• Discriminative Transfer Learning for General Image Restoration
• Array SAR 3D Sparse Imaging Based on Regularization by Denoising Under Few Observed Data
• Provable Preconditioned Plug-and-Play Approach for Compressed Sensing MRI Reconstruction
• Tuning-free Plug-and-Play Hyperspectral Image Deconvolution with Deep Priors
• Plug-and-Play Regularization using Linear Solvers
• Designing Stable Neural Networks using Convex Analysis and ODEs
• Supervision by Denoising for Medical Image Segmentation
• On the Contractivity of Plug-and-Play Operators
• An ${\ell }^1$-Plug-and-Play Approach for MPI Using a Zero Shot Denoiser with Evaluation on the 3D Open MPI Dataset
• Deep learning-based deconvolution for interferometric radio transient reconstruction
• Monotone Lipschitz-Gradient Denoiser: Explainability of Operator Regularization Approaches Free From Lipschitz Constant Control
• Automatic Foreground Extraction from Imperfect Backgrounds using Multi-Agent Consensus Equilibrium
• Compressive Computed Tomography Reconstruction through Denoising Approximate Message Passing
• Solving RED with Weighted Proximal Methods
• On the Strong Convexity of PnP Regularization Using Linear Denoisers
• Convolutional Dictionary Regularizers for Tomographic Inversion
• Overcoming Distribution Shifts in Plug-and-Play Methods with Test-Time Training
• Fidelity-preserving enhancement of ptychography with foundational text-to-image models
• Stabilizing RED using the Koopman Operator
• Joint multiband deconvolution for Euclid and Vera C. Rubin images