Reservoir observer enhanced with residual calibration and attention mechanism

Abstract

Reservoir observers provide a data-driven approach to the inference of unmeasured variables from observed ones for nonlinear dynamical systems. While previous studies have demonstrated wide applicability, their performance may vary considerably with different input variables, even compromising reliability in the worst cases. To enhance the performance of inference, we integrate residual calibration and attention mechanism into the reservoir observer design. The residual calibration module leverages information from the estimation residuals to refine the observer output, and the attention mechanism exploits the temporal dependencies of the data to enrich the representation of reservoir internal dynamics. Experiments on typical chaotic systems demonstrate that our method substantially improves inference accuracy, especially for the worst cases resulting from the traditional reservoir observers. We also invoke the notion of transfer entropy to explain the reason for the input-dependent observation discrepancy and the effectiveness of the proposed method.

References in corpus (9)

• Measuring Information Transfer
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• Large-Scale Optical Reservoir Computing for Spatiotemporal Chaotic Systems Prediction
• Using a reservoir computer to learn chaotic attractors, with applications to chaos synchronisation and cryptography
• Using reservoir computers to distinguish chaotic signals
• Machine-learning inference of fluid variables from data using reservoir computing
• Good and bad predictions: Assessing and improving the replication of chaotic attractors by means of reservoir computing
• Learning Hamiltonian dynamics by reservoir computer
• Synchronizing Chaos using Reservoir Computing