Information hiding cameras: optical concealment of object information into ordinary images

Abstract

Data protection methods like cryptography, despite being effective, inadvertently signal the presence of secret communication, thereby drawing undue attention. Here, we introduce an optical information hiding camera integrated with an electronic decoder, optimized jointly through deep learning. This information hiding-decoding system employs a diffractive optical processor as its front-end, which transforms and hides input images in the form of ordinary-looking patterns that deceive/mislead human observers. This information hiding transformation is valid for infinitely many combinations of secret messages, all of which are transformed into ordinary-looking output patterns, achieved all-optically through passive light-matter interactions within the optical processor. By processing these ordinary-looking output images, a jointly-trained electronic decoder neural network accurately reconstructs the original information hidden within the deceptive output pattern. We numerically demonstrated our approach by designing an information hiding diffractive camera along with a jointly-optimized convolutional decoder neural network. The efficacy of this system was demonstrated under various lighting conditions and noise levels, showing its robustness. We further extended this information hiding camera to multi-spectral operation, allowing the concealment and decoding of multiple images at different wavelengths, all performed simultaneously in a single feed-forward operation. The feasibility of our framework was also demonstrated experimentally using THz radiation. This optical encoder-electronic decoder-based co-design provides a novel information hiding camera interface that is both high-speed and energy-efficient, offering an intriguing solution for visual information security.

arXiv comment26 Pages, 8 Figures

References in corpus (7)

• All-Optical Machine Learning Using Diffractive Deep Neural Networks
• Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy
• Misalignment Resilient Diffractive Optical Networks
• To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
• Universal Linear Intensity Transformations Using Spatially-Incoherent Diffractive Processors
• Data class-specific all-optical transformations and encryption
• Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks

Cited by in corpus (6)

• Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network
• Integration of Programmable Diffraction with Digital Neural Networks
• Universal point spread function engineering for 3D optical information processing
• Structural Vibration Monitoring with Diffractive Optical Processors
• Optimizing Structured Surfaces for Diffractive Waveguides
• BlurryScope enables compact, cost-effective scanning microscopy for HER2 scoring using deep learning on blurry images