InSPECtor: an end-to-end design framework for compressive pixelated hyperspectral instruments

Abstract

Classic designs of hyperspectral instrumentation densely sample the spatial and spectral information of the scene of interest. Data may be compressed after the acquisition. In this paper we introduce a framework for the design of an optimized, micro-patterned snapshot hyperspectral imager that acquires an optimized subset of the spatial and spectral information in the scene. The data is thereby compressed already at the sensor level, but can be restored to the full hyperspectral data cube by the jointly optimized reconstructor. This framework is implemented with TensorFlow and makes use of its automatic differentiation for the joint optimization of the layout of the micro-patterned filter array as well as the reconstructor. We explore the achievable compression ratio for different numbers of filter passbands, number of scanning frames, and filter layouts using data collected by the Hyperscout instrument. We show resulting instrument designs that take snapshot measurements without losing significant information while reducing the data volume, acquisition time, or detector space by a factor of 40 as compared to classic, dense sampling. The joint optimization of a compressive hyperspectral imager design and the accompanying reconstructor provides an avenue to substantially reduce the data volume from hyperspectral imagers.

arXiv comment23 pages, 12 figures, published in Applied Optics

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• TensorFlow: A system for large-scale machine learning
• Deep Learning for Classification of Hyperspectral Data: A Comparative Review
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter array
• Learning-based Compressive Subsampling
• Computational Spectral Imaging: A Contemporary Overview
• Learning a Compressed Sensing Measurement Matrix via Gradient Unrolling
• Joint Denoising and Demosaicking with Green Channel Prior for Real-world Burst Images
• Compressive Spectral Imaging with Diffractive Lenses
• D${}^{\text{2}}$UF: Deep Coded Aperture Design and Unrolling Algorithm for Compressive Spectral Image Fusion
• Deep Optical Coding Design in Computational Imaging
• End-to-end design framework for compressed on-chip pixel-wise spectro-polarimeters