Bayesian Photonic Accelerators for Energy Efficient and Noise Robust Neural Processing

Abstract

Artificial neural networks are efficient computing platforms inspired by the brain. Such platforms can tackle a vast area of real-life tasks ranging from image processing to language translation. Silicon photonic integrated chips (PICs), by employing coherent interactions in Mach-Zehnder interferometers, are promising accelerators offering record low power consumption and ultra-fast matrix multiplication. Such photonic accelerators, however, suffer from phase uncertainty due to fabrication errors and crosstalk effects that inhibit the development of high-density implementations. In this work, we present a Bayesian learning framework for such photonic accelerators. In addition to the conventional log-likelihood optimization path, two novel training schemes are derived, namely a regularized version and a fully Bayesian learning scheme. They are applied on a photonic neural network with 512 phase shifters targeting the MNIST dataset. The new schemes, when combined with a pre-characterization stage that provides the passive offsets, are able to dramatically decrease the operational power of the PIC beyond 70%, with just a slight loss in classification accuracy. The full Bayesian scheme, apart from this energy reduction, returns information with respect to the sensitivity of the phase shifters. This information is used to de-activate 31% of the phase actuators and, thus, significantly simplify the driving system.

arXiv comment10 pages, 8 figures

References in corpus (10)

• Deep Learning with Coherent Nanophotonic Circuits
• Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing
• Self-Configuring Universal Linear Optical Component
• Reprogrammable Electro-Optic Nonlinear Activation Functions for Optical Neural Networks
• Bayesian Compression for Deep Learning
• Design of optical neural networks with component imprecisions
• Matrix optimization on universal unitary photonic devices
• Scaling Up Silicon Photonic-based Accelerators: Challenges and Opportunities
• Quantum optical realization of arbitrary linear transformations allowing for loss and gain
• All-Spin Bayesian Neural Networks