Single-pixel imaging via data-driven and deep image prior dual networks

Abstract

Single-pixel imaging(SPI),especially when integrated with deep neural networks like deep image prior networks (DIP-Net) or data-driven networks (DD-Net), has gained considerable attention for its capability to generate high-quality reconstructed images, even in the presence of sub-sampling conditions. However, DIP-Net often requires thousands of iterations to achieve high-quality image reconstruction, and DD-Net performs optimally only when the target closely resembles the features present in its training set. To overcome these limitations, we propose a dual-network iterative optimization (SPI-DNIO) framework that combines the strengths of both DD-Net and DIP-Net. It has been demonstrated that this approach can recover high-quality images with fewer iteration steps. Furthermore, to address the challenge of SPI inputs having less effective information at low sampling rates, we have designed a residual block enriched with gradient information, which can convey details to deeper layers, thereby enhancing the deep network's learning capabilities. We have applied these techniques to both indoor experiments with active lighting and outdoor long-range experiments with passive lighting. Our experimental results confirm the exceptional reconstruction capabilities and generalization performance of the SPI-DNIO framework.

References in corpus (11)

• Compressive ghost imaging
• Correlated imaging, quantum and classical
• Single-pixel 3D imaging with time-based depth resolution
• Hadamard single-pixel imaging versus Fourier single-pixel imaging
• Non-invasive, near-field terahertz imaging of hidden objects using a single pixel detector
• Compressive Fluorescence Microscopy for Biological and Hyperspectral Imaging
• Super sub-Nyquist single-pixel imaging by means of cake-cutting Hadamard basis sort
• Real-time single-pixel video imaging with Fourier domain regularization
• Solution of Physics-based Bayesian Inverse Problems with Deep Generative Priors
• Non-imaging single-pixel sensing with optimized binary modulation
• Early Stopping for Deep Image Prior