Designing lensless imaging systems to maximize information capture

Abstract

Mask-based lensless imaging uses an optical encoder (e.g. a phase or amplitude mask) to capture measurements, then a computational decoding algorithm to reconstruct images. In this work, we evaluate and design lensless encoders based on the information content of their measurements using mutual information estimation. Our approach formalizes the object-dependent nature of lensless imaging and quantifies the interdependence between object sparsity, encoder multiplexing, and noise. Our analysis reveals that optimal encoder designs should tailor encoder multiplexing to object sparsity for maximum information capture, and that all optimally-encoded measurements share the same level of sparsity. Using mutual information-based optimization, we design information-optimal encoders for compressive imaging of fixed object distributions. Our designs demonstrate improved downstream reconstruction performance for objects in the distribution, without requiring joint optimization with a specific reconstruction algorithm. We validate our approach experimentally by evaluating lensless imaging systems directly from captured measurements, without the need for image formation models, reconstruction algorithms, or ground truth data. Our comprehensive analysis establishes design and engineering principles for lensless imaging systems, and offers a model for the study of general multiplexing systems, especially those with object-dependent performance.

27 pages, 12 figures

References in corpus (15)

• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• DeepSTORM3D: dense three dimensional localization microscopy and point spread function design by deep learning
• Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array
• Learned reconstructions for practical mask-based lensless imaging
• Scaling Laws for Autoregressive Generative Modeling
• FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurements
• Single-Shot 3D Widefield Fluorescence Imaging with a Computational Miniature Mesoscope
• Untrained networks for compressive lensless photography
• Curriculum Learning for ab initio Deep Learned Refractive Optics
• Increasing a microscope's effective field of view via overlapped imaging and machine learning
• Comparison of Gini index and Tamura coefficient for holographic autofocusing based on the edge sparsity of the complex optical wavefront
• Learning rich optical embeddings for privacy-preserving lensless image classification
• LenslessFace: An End-to-End Optimized Lensless System for Privacy-Preserving Face Verification
• Computationally Efficient Information-Driven Optical Design with Interchanging Optimization
• Scalable dataset acquisition for data-driven lensless imaging