Ghost translation

Abstract

Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulation database assists the network in achieving signal translation ability. The experimental single-pixel detector's signal will be `translated' into a 2D image in an end-to-end manner. High-quality images with no background noise can be retrieved at a sampling ratio as low as 2%. The illumination patterns can be either well-designed speckle patterns for sub-Nyquist imaging or random speckle patterns. Moreover, our method is robust to noise interference. This translation mechanism opens a new direction for DNN-assisted ghost imaging and can be used in various computational imaging scenarios.

10 pages, 8 figures

References in corpus (11)

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Hadamard single-pixel imaging versus Fourier single-pixel imaging
• Hyperspectral terahertz microscopy via nonlinear ghost imaging
• Ghost Imaging with Atoms
• Lensless ghost imaging with true thermal light
• Does deep learning always outperform simple linear regression in optical imaging?
• Imaging through scattering media via spatial-temporal encoded pattern illumination
• 0.8% Nyquist computational ghost imaging via non-experimental deep learning
• Sub-Nyquist computational ghost imaging with orthonormalized colored noise pattern
• Deep-learned speckle pattern and its application to ghost imaging
• Computational Ghost Imaging