Optimizing Memory in Reservoir Computers
arXiv:2201.01605 · doi:10.1063/5.0078151
Abstract
A reservoir computer is a way of using a high dimensional dynamical system for computation. One way to construct a reservoir computer is by connecting a set of nonlinear nodes into a network. Because the network creates feedback between nodes, the reservoir computer has memory. If the reservoir computer is to respond to an input signal in a consistent way (a necessary condition for computation), the memory must be fading; that is, the influence of the initial conditions fades over time. How long this memory lasts is important for determining how well the reservoir computer can solve a particular problem. In this paper I describe ways to vary the length of the fading memory in reservoir computers. Tuning the memory can be important to achieve optimal results in some problems; too much or too little memory degrades the accuracy of the computation.
References in corpus (12)
- Statistical mechanics of complex networks
- Recent Advances in Physical Reservoir Computing: A Review
- Next Generation Reservoir Computing
- Attractor Reconstruction by Machine Learning
- Embedding and Approximation Theorems for Echo State Networks
- Using a reservoir computer to learn chaotic attractors, with applications to chaos synchronisation and cryptography
- Rapid Time Series Prediction with a Hardware-Based Reservoir Computer
- Do Reservoir Computers Work Best at the Edge of Chaos?
- Consistency in Echo-State Networks
- Chaos on compact manifolds: Differentiable synchronizations beyond the Takens theorem
- Breaking Symmetries of the Reservoir Equations in Echo State Networks
- Consistency capacity of reservoir computers
Cited by in corpus (7)
- Engineered Dissipation for Quantum Information Science
- Perspective on unconventional computing using magnetic skyrmions
- Exploring quantum mechanical advantage for reservoir computing
- Catch-22s of reservoir computing
- Time Shifts to Reduce the Size of Reservoir Computers
- Artificial Spin Ice: A Tutorial on Design and Control of Geometry, Microstate, Magnon Dynamics & Neuromorphic Computing
- Connection between memory performance and optical absorption in quantum reservoir computing