Tailored minimal reservoir computing: on the bidirectional connection between nonlinearities in the reservoir and in data
arXiv:2504.17503 · doi:10.1063/5.0272793
Abstract
We study how the degree of nonlinearity in the input data affects the optimal design of reservoir computers, focusing on how closely the model's nonlinearity should align with that of the data. By reducing minimal RCs to a single tunable nonlinearity parameter, we explore how the predictive performance varies with the degree of nonlinearity in the reservoir. To provide controlled testbeds, we generalize to the fractional Halvorsen system, a novel chaotic system with fractional exponents. Our experiments reveal that the prediction performance is maximized when the reservoir's nonlinearity matches the nonlinearity present in the data. In cases where multiple nonlinearities are present in the data, we find that the correlation dimension of the predicted signal is reconstructed correctly when the smallest nonlinearity is matched. We use this observation to propose a method for estimating the minimal nonlinearity in unknown time series by sweeping the reservoir exponent and identifying the transition to a successful reconstruction. Applying this method to both synthetic and real-world datasets, including financial time series, we demonstrate its practical viability. Finally, we transfer these insights to classical RC by augmenting traditional architectures with fractional, generalized reservoir states. This yields performance gains, particularly in resource-constrained scenarios such as physical reservoirs, where increasing reservoir size is impractical or economically unviable. Our work provides a principled route toward tailoring RCs to the intrinsic complexity of the systems they aim to model.
16 pages, 12 figures
References in corpus (15)
- Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
- Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
- Next Generation Reservoir Computing
- Attractor Reconstruction by Machine Learning
- PySINDy: A comprehensive Python package for robust sparse system identification
- Network Structure Effects in Reservoir Computers
- Good and bad predictions: Assessing and improving the replication of chaotic attractors by means of reservoir computing
- Learning Spatiotemporal Chaos Using Next-Generation Reservoir Computing
- Breaking Symmetries of the Reservoir Equations in Echo State Networks
- Revisiting algorithms for generating surrogate time series
- Catch-22s of reservoir computing
- Forecasting trends in food security with real time data
- Surrogate-assisted network analysis of nonlinear time series
- Reservoir Computing with Generalized Readout based on Generalized Synchronization
- Phase Walk Analysis of Leptokurtic Time Series