Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array

Abstract

Hyperspectral imaging is useful for applications ranging from medical diagnostics to agricultural crop monitoring; however, traditional scanning hyperspectral imagers are prohibitively slow and expensive for widespread adoption. Snapshot techniques exist but are often confined to bulky benchtop setups or have low spatio-spectral resolution. In this paper, we propose a novel, compact, and inexpensive computational camera for snapshot hyperspectral imaging. Our system consists of a tiled spectral filter array placed directly on the image sensor and a diffuser placed close to the sensor. Each point in the world maps to a unique pseudorandom pattern on the spectral filter array, which encodes multiplexed spatio-spectral information. By solving a sparsity-constrained inverse problem, we recover the hyperspectral volume with sub-super-pixel resolution. Our hyperspectral imaging framework is flexible and can be designed with contiguous or non-contiguous spectral filters that can be chosen for a given application. We provide theory for system design, demonstrate a prototype device, and present experimental results with high spatio-spectral resolution.

arXiv comment10 pages, 10 figures, Optica

References in corpus (6)

• On-Chip Random Spectrometer
• Compressed Sensing using Generative Models
• Single-shot multispectral imaging with a monochromatic camera
• Learned reconstructions for practical mask-based lensless imaging
• Speckle-based hyperspectral imaging combining multiple scattering and compressive sensing in nanowire mats
• Programmable Spectrometry -- Per-pixel Classification of Materials using Learned Spectral Filters

Cited by in corpus (20)

• A broadband hyperspectral image sensor with high spatio-temporal resolution
• End-to-end metasurface inverse design for single-shot multi-channel imaging
• Untrained networks for compressive lensless photography
• Computational Spectral Imaging: A Contemporary Overview
• Compressive Spectral Image Reconstruction using Deep Prior and Low-Rank Tensor Representation
• Spinning Metasurface Stack for Spectro-polarimetric Thermal Imaging
• Snapshot hyperspectral imaging with quantum correlated photons
• mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics
• High-resolution Multi-spectral Imaging with Diffractive Lenses and Learned Reconstruction
• Non-invasive color imaging through scattering medium under broadband illumination
• Polarized hyperspectral imaging with single fiber bundle via incoherent light transmission matrix approach
• Single-pixel diffuser camera
• Temporal compressive edge imaging enabled by a lensless diffuser camera
• Designing lensless imaging systems to maximize information capture
• Mid-infrared nonlinear pinhole imaging
• End-to-End Nanophotonic Inverse Design for Imaging and Polarimetry
• Collaborative On-Sensor Array Cameras
• A Simple Framework for 3D Lensless Imaging with Programmable Masks
• InSPECtor: an end-to-end design framework for compressive pixelated hyperspectral instruments
• Hybrid Diffractive Optics Design via Hardware-in-the-Loop Methodology for Achromatic Extended-Depth-of-Field Imaging