Computational Spectral Imaging: A Contemporary Overview

Abstract

Spectral imaging collects and processes information along spatial and spectral coordinates quantified in discrete voxels, which can be treated as a 3D spectral data cube. The spectral images (SIs) allow identifying objects, crops, and materials in the scene through their spectral behavior. Since most spectral optical systems can only employ 1D or maximum 2D sensors, it is challenging to directly acquire the 3D information from available commercial sensors. As an alternative, computational spectral imaging (CSI) has emerged as a sensing tool where the 3D data can be obtained using 2D encoded projections. Then, a computational recovery process must be employed to retrieve the SI. CSI enables the development of snapshot optical systems that reduce acquisition time and provide low computational storage costs compared to conventional scanning systems. Recent advances in deep learning (DL) have allowed the design of data-driven CSI to improve the SI reconstruction or, even more, perform high-level tasks such as classification, unmixing, or anomaly detection directly from 2D encoded projections. This work summarises the advances in CSI, starting with SI and its relevance; continuing with the most relevant compressive spectral optical systems. Then, CSI with DL will be introduced, and the recent advances in combining the physical optical design with computational DL algorithms to solve high-level tasks.

References in corpus (8)

• Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review
• Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array
• A Gaussian mixture model representation of endmember variability in hyperspectral unmixing
• Compressive Spectral Image Reconstruction using Deep Prior and Low-Rank Tensor Representation
• Compressive Spectral Imaging with Diffractive Lenses
• High-resolution Multi-spectral Imaging with Diffractive Lenses and Learned Reconstruction
• A Fast Alternating Minimization Algorithm for Coded Aperture Snapshot Spectral Imaging Based on Sparsity and Deep Image Priors
• Mixture-Net: Low-Rank Deep Image Prior Inspired by Mixture Models for Spectral Image Recovery

Cited by in corpus (3)

• Interferometer response characterization algorithm for multi-aperture Fabry-Perot imaging spectrometers
• InSPECtor: an end-to-end design framework for compressive pixelated hyperspectral instruments
• Inverse design for robust inference in integrated computational spectrometry