Deep Photonic Reservoir Computer for Speech Recognition

Abstract

Speech recognition is a critical task in the field of artificial intelligence and has witnessed remarkable advancements thanks to large and complex neural networks, whose training process typically requires massive amounts of labeled data and computationally intensive operations. An alternative paradigm, reservoir computing, is energy efficient and is well adapted to implementation in physical substrates, but exhibits limitations in performance when compared to more resource-intensive machine learning algorithms. In this work we address this challenge by investigating different architectures of interconnected reservoirs, all falling under the umbrella of deep reservoir computing. We propose a photonic-based deep reservoir computer and evaluate its effectiveness on different speech recognition tasks. We show specific design choices that aim to simplify the practical implementation of a reservoir computer while simultaneously achieving high-speed processing of high-dimensional audio signals. Overall, with the present work we hope to help the advancement of low-power and high-performance neuromorphic hardware.

References in corpus (24)

• Recent Advances in Physical Reservoir Computing: A Review
• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Parallel convolution processing using an integrated photonic tensor core
• 11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks
• Optoelectronic Reservoir Computing
• Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems
• Brain-inspired computing: We need a master plan
• Reinforcement Learning in a large scale photonic Recurrent Neural Network
• High performance photonic reservoir computer based on a coherently driven passive cavity
• Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium
• Human action recognition with a large-scale brain-inspired photonic computer
• Survey of Machine Learning Accelerators
• Random Projections through multiple optical scattering: Approximating kernels at the speed of light
• Using a reservoir computer to learn chaotic attractors, with applications to chaos synchronisation and cryptography
• Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalisation
• Trainable and Dynamic Computing: Error Backpropagation through Physical Media
• Classification of time-domain waveforms using a speckle-based optical reservoir computer
• Brain-inspired photonic signal processor for periodic pattern generation and chaotic system emulation
• Deep Photonic Reservoir Computer Based on Frequency Multiplexing with Fully Analog Connection Between Layers
• Embodiment of Learning in Electro-Optical Signal Processors
• Photonic Delay Systems as Machine Learning Implementations
• High Speed Human Action Recognition using a Photonic Reservoir Computer
• Experimental demonstration of bandwidth enhancement in photonic time delay reservoir computing
• The role of delay-times in delay-based Photonic Reservoir Computing