Supervised machine learning to estimate instabilities in chaotic systems: estimation of local Lyapunov exponents
arXiv:2202.04944 · doi:10.1002/qj.4450
Abstract
In chaotic dynamical systems such as the weather, prediction errors grow faster in some situations than in others. Real-time knowledge about the error growth could enable strategies to adjust the modelling and forecasting infrastructure on-the-fly to increase accuracy or reduce computation time. One could, e.g., change the ensemble size, or the distribution and type of target observations. Local Lyapunov exponents are known indicators of the rate at which very small prediction errors grow over a finite time interval. However, their computation is very expensive: it requires maintaining and evolving a tangent linear model, orthogonalisation algorithms and storing large matrices. In this feasibility study, we investigate the accuracy of supervised machine learning in estimating the current local Lyapunov exponents, from input of current and recent time steps of the system trajectory, as an alternative to the classical method. Thus machine learning is not used here to emulate a physical model or some of its components, but non intrusively as a complementary tool. We test four popular supervised learning algorithms: regression trees, multilayer perceptrons, convolutional neural networks and long short-term memory networks. Experiments are conducted on two low-dimensional chaotic systems of ordinary differential equations, the Rössler and the Lorenz 63 models. We find that on average the machine learning algorithms predict the stable local Lyapunov exponent accurately, the unstable exponent reasonably accurately, and the neutral exponent only somewhat accurately. We show that greater prediction accuracy is associated with local homogeneity of the local Lyapunov exponents on the system attractor. Importantly, the situations in which (forecast) errors grow fastest are not necessarily the same as those where it is more difficult to predict local Lyapunov exponents with machine learning.
arXiv comment37 pages, 10 Figures
References in corpus (21)
- Scikit-learn: Machine Learning in Python
- Practical Bayesian Optimization of Machine Learning Algorithms
- Pruning Convolutional Neural Networks for Resource Efficient Inference
- Deep learning to represent sub-grid processes in climate models
- Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
- WeatherBench: A benchmark dataset for data-driven weather forecasting
- Characterizing dynamics with covariant Lyapunov vectors
- Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events
- Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
- Bridging observation, theory and numerical simulation of the ocean using Machine Learning
- Theory and computation of covariant Lyapunov vectors
- Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation
- Predictability of large-scale atmospheric motions: Lyapunov exponents and error dynamics
- Computing covariant vectors, Lyapunov vectors, Oseledets vectors, and dichotomy projectors: a comparative numerical study
- A New Mathematical Framework for Atmospheric Blocking Events
- Attention-based Convolutional Autoencoders for 3D-Variational Data Assimilation
- Degenerate Kalman filter error covariances and their convergence onto the unstable subspace
- Efficient Multiplication of Dense Matrices over GF(2)
- Model and Data Reduction for Data Assimilation: Particle Filters Employing Projected Forecasts and Data with Application to a Shallow Water Model
- On the use of near-neutral Backward Lyapunov Vectors to get reliable ensemble forecasts in coupled ocean-atmosphere systems
- Inferring the instability of a dynamical system from the skill of data assimilation exercises