Photonic tensor cores for machine learning

Abstract

With an ongoing trend in computing hardware towards increased heterogeneity, domain-specific co-processors are emerging as alternatives to centralized paradigms. The tensor core unit (TPU) has shown to outperform graphic process units by almost 3-orders of magnitude enabled by higher signal throughout and energy efficiency. In this context, photons bear a number of synergistic physical properties while phase-change materials allow for local nonvolatile mnemonic functionality in these emerging distributed non van-Neumann architectures. While several photonic neural network designs have been explored, a photonic TPU to perform matrix vector multiplication and summation is yet outstanding. Here we introduced an integrated photonics-based TPU by strategically utilizing a) photonic parallelism via wavelength division multiplexing, b) high 2 Peta-operations-per second throughputs enabled by 10s of picosecond-short delays from optoelectronics and compact photonic integrated circuitry, and c) zero power-consuming novel photonic multi-state memories based on phase-change materials featuring vanishing losses in the amorphous state. Combining these physical synergies of material, function, and system, we show that the performance of this 8-bit photonic TPU can be 2-3 orders higher compared to an electrical TPU whilst featuring similar chip areas. This work shows that photonic specialized processors have the potential to augment electronic systems and may perform exceptionally well in network-edge devices in the looming 5G networks and beyond.

References in corpus (1)

• Efficient, Compact and Low Loss Thermo-Optic Phase Shifter in Silicon

Cited by in corpus (14)

• Nanoscale neural network using non-linear spin-wave interference
• Prospects and applications of photonic neural networks
• Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network
• Scalable massively parallel computing using continuous-time data representation in nanoscale crossbar array
• Massively Parallel Universal Linear Transformations using a Wavelength-Multiplexed Diffractive Optical Network
• Artificial Neural Networks for Photonic Applications: From Algorithms to Implementation
• Integrated Photonic Tensor Processing Unit for a Matrix Multiply: a Review
• Photonic neural networks based on integrated silicon microresonators
• Coherent photonic crossbar as a universal linear operator
• Realising and compressing quantum circuits with quantum reservoir computing
• Image classification using collective optical modes of an array of nanolasers
• Fast, low-loss all-optical phase modulation in warm rubidium vapour
• Sub-quadratic scalable approximate linear converter using multi-plane light conversion with low-entropy mode mixers
• All-Optical Doubly Resonant Cavities for ReLU Function in Nanophotonic Deep Learning