Physics-Informed Echo State Networks

Abstract

We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their predictions do not violate physical laws. This is achieved by introducing an additional loss function during the training, which is based on the system's governing equations. The additional loss function penalizes non-physical predictions without the need of any additional training data. This approach is demonstrated on a chaotic Lorenz system and a truncation of the Charney-DeVore system. Compared to the conventional ESNs, the physics-informed ESNs improve the predictability horizon by about two Lyapunov times. This approach is also shown to be robust with regard to noise. The proposed framework shows the potential of using machine learning combined with prior physical knowledge to improve the time-accurate prediction of chaotic dynamical systems.

10 pages, 11 figures. arXiv admin note: substantial text overlap with arXiv:1906.11122

References in corpus (9)

• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Turbulence Modeling in the Age of Data
• Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks
• A Comprehensive Physics-Informed Machine Learning Framework for Predictive Turbulence Modeling
• Physics-Informed Machine Learning Approach for Augmenting Turbulence Models: A Comprehensive Framework
• Deep Learning of Vortex Induced Vibrations
• Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model
• Data-assisted reduced-order modeling of extreme events in complex dynamical systems
• Echo State Networks with Self-Normalizing Activations on the Hyper-Sphere

Cited by in corpus (5)

• Stability analysis of chaotic systems from data
• Learning thermoacoustic interactions in combustors using a physics-informed neural network
• CD-ROM: Complemented Deep-Reduced Order Model
• Physics-Informed Long Short-Term Memory for Forecasting and Reconstruction of Chaos
• Frame-independent vector-cloud neural network for nonlocal constitutive modeling on arbitrary grids