A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learning

Abstract

Reservoir computing (RC), first applied to temporal signal processing, is a recurrent neural network in which neurons are randomly connected. Once initialized, the connection strengths remain unchanged. Such a simple structure turns RC into a non-linear dynamical system that maps low-dimensional inputs into a high-dimensional space. The model's rich dynamics, linear separability, and memory capacity then enable a simple linear readout to generate adequate responses for various applications. RC spans areas far beyond machine learning, since it has been shown that the complex dynamics can be realized in various physical hardware implementations and biological devices. This yields greater flexibility and shorter computation time. Moreover, the neuronal responses triggered by the model's dynamics shed light on understanding brain mechanisms that also exploit similar dynamical processes. While the literature on RC is vast and fragmented, here we conduct a unified review of RC's recent developments from machine learning to physics, biology, and neuroscience. We first review the early RC models, and then survey the state-of-the-art models and their applications. We further introduce studies on modeling the brain's mechanisms by RC. Finally, we offer new perspectives on RC development, including reservoir design, coding frameworks unification, physical RC implementations, and interaction between RC, cognitive neuroscience and evolution.

51 pages, 19 figures, IEEE Access

References in corpus (13)

• Explaining and Harnessing Adversarial Examples
• Advances in the Physics of Magnetic Skyrmions and Perspective for Technology
• Next Generation Reservoir Computing
• High performance photonic reservoir computer based on a coherently driven passive cavity
• Tutorial: Photonic Neural Networks in Delay Systems
• Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets
• Computational Capabilities of Random Automata Networks for Reservoir Computing
• Memristor models for machine learning
• Signals to Spikes for Neuromorphic Regulated Reservoir Computing and EMG Hand Gesture Recognition
• Deep Reservoir Computing Using Cellular Automata
• Reservoir Computing using High Order Synchronization of Coupled Oscillators
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped
• Road traffic reservoir computing