computational imaging

Deep Scene-Driven Ordering of Hadamard Basis for Single-Pixel Spectral Imaging

arXiv:2607.15045

summary

The paper introduces a deep learning framework that orders the Hadamard basis adaptively to scene content for single‑pixel spectral imaging, improving visual and near‑infrared image quality over fixed coding designs.

Abstract

Spectral images are highly valuable for various applications, including environmental monitoring and precision agriculture. However, the high cost of specialized sensors limits the wide use of this technology in numerous applications. Current alternatives to acquire high spatial-spectral resolution spectral images, like Single-Pixel Imaging (SPI) enhanced with Deep Optical Coding Design (DOCD), have limitations due to their non-feedback optical designs, leading to limited image quality, with optimal performance achieved only for the specific scenes used during training. This work reformulates the DOCD framework to handle the scene-driven ordering of the Hadamard basis within the SPI architecture for spectral imaging. Taking into account that SPI usually acquires hundreds of snapshots, our approach introduces a scene-driven ordering of the Hadamard matrix for flexible SPI modulation pattern selection based on scene characteristics in an end-to-end optimization. Simulations on spectral datasets and real test-bed acquisitions demonstrate the effectiveness of the proposed method in improving the quality of VIS and NIR spectral images compared to fixed designs.

Topics & keywords

#single-pixel imaging#spectral imaging#hadamard coding#deep optical coding#scene-driven ordering#end-to-end optimizationHadamard basissingle-pixel cameraspectral reconstructiondeep learningoptical coding designend-to-end training