Photonic real time video image signal processor at 17Tb/s based on a Kerr microcomb
arXiv:2401.07197 · doi:10.1038/s44172-023-00135-7
Abstract
Signal processing has become central to many fields, from coherent optical telecommunications, where it is used to compensate signal impairments, to video image processing. Image processing is particularly important for observational astronomy, medical diagnosis, autonomous driving, big data and artificial intelligence. For these applications, signal processing traditionally has mainly been performed electronically. However these, as well as new applications, particularly those involving real time video image processing, are creating unprecedented demand for ultrahigh performance, including high bandwidth and reduced energy consumption. Here, we demonstrate a photonic signal processor operating at 17 Terabits/s and use it to process video image signals in real-time. The system processes 400,000 video signals concurrently, performing 34 functions simultaneously that are key to object edge detection, edge enhancement and motion blur. As compared with spatial-light devices used for image processing, our system is not only ultra-high speed but highly reconfigurable and programable, able to perform many different functions without any change to the physical hardware. Our approach is based on an integrated Kerr soliton crystal microcomb, and opens up new avenues for ultrafast robotic vision and machine learning.
arXiv comment20 pages, 5 figures, 71 references
References in corpus (31)
- Optical frequency comb generation from a monolithic microresonator
- Temporal solitons in optical microresonators
- All-optical signal processing platforms for CMOS compatible integrated nonlinear optics
- 11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks
- Microresonator solitons for massively parallel coherent optical communications
- Microresonator Soliton Dual-Comb Spectroscopy
- An Integrated-Photonics Optical-Frequency Synthesizer
- Ultrafast optical ranging using microresonator soliton frequency combs
- Photonic chip based optical frequency comb using soliton induced Cherenkov radiation
- Fully integrated ultra-low power Kerr comb generation
- Massively parallel coherent laser ranging using soliton microcombs
- Soliton Microcomb Range Measurement
- Single-chip photonic deep neural network for instantaneous image classification
- Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit
- Photonic RF and microwave reconfigurable filters and true time delays based on an integrated optical Kerr frequency comb source
- A Radio Frequency Channelizer based on Cascaded Integrated Micro-ring Resonator Optical Comb Sources and Filters
- Photonic radio frequency and microwave intensity differentiator based on an optical frequency comb source in an integrated micro-ring resonator
- High performance photonic microwave filters based on a 50GHz optical soliton crystal Kerr micro-comb
- Optical data transmission at 44Tb/s and 10 bits/s/Hz over the C-band with standard fibre and a single micro-comb source
- Microwave and RF signal processing based on integrated soliton crystal optical microcombs
- Microwave photonic fractional Hilbert transformer with an integrated optical soliton crystal micro-comb
- Microwave Q-band oscillator at 49GHz for broadband frequency conversion based on a Kerr optical soliton crystal micro-comb
- Optical Kerr soliton crystal microcomb source for RF photonic fractional differentiation
- Comparison of photonic transversal RF spectral filters based on different optical microcombs
- High bandwidth temporal RF photonic signal processing with Kerr micro-combs: integration, fractional differentiation and Hilbert transforms
- Photonic radio frequency and microwave integration based on a multi-wavelength 49GHz Kerr microcomb source
- Applications of integrated optical microcombs
- Laser Cavity-Soliton Micro-Combs
- Highly tunable broadband RF photonic fractional Hilbert transformer based on a Kerr soliton crystal microcomb source
- Integral order photonic RF and microwave signal processors based on soliton crystal Kerr micro-combs
- Human action recognition with a large-scale brain-inspired photonic computer