Conditional Gaussian Nonlinear System: a Fast Preconditioner and a Cheap Surrogate Model For Complex Nonlinear Systems

Abstract

Developing suitable approximate models for analyzing and simulating complex nonlinear systems is practically important. This paper aims at exploring the skill of a rich class of nonlinear stochastic models, known as the conditional Gaussian nonlinear system (CGNS), as both a cheap surrogate model and a fast preconditioner for facilitating many computationally challenging tasks. The CGNS preserves the underlying physics to a large extent and can reproduce intermittency, extreme events and other non-Gaussian features in many complex systems arising from practical applications. Three interrelated topics are studied. First, the closed analytic formulae of solving the conditional statistics provide an efficient and accurate data assimilation scheme. It is shown that the data assimilation skill of a suitable CGNS approximate forecast model outweighs that by applying an ensemble method even to the perfect model with strong nonlinearity, where the latter suffers from filter divergence. Second, the CGNS allows the development of a fast algorithm for simultaneously estimating the parameters and the unobserved variables with uncertainty quantification in the presence of only partial observations. Utilizing an appropriate CGNS as a preconditioner significantly reduces the computational cost in accurately estimating the parameters in the original complex system. Finally, the CGNS advances rapid and statistically accurate algorithms for computing the probability density function and sampling the trajectories of the unobserved state variables. These fast algorithms facilitate the development of an efficient and accurate data-driven method for predicting the linear response of the original system with respect to parameter perturbations based on a suitable CGNS preconditioner.

References in corpus (29)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Kernel density estimation via diffusion
• The GNAT method for nonlinear model reduction: effective implementation and application to computational fluid dynamics and turbulent flows
• Data-Driven POD-Galerkin Reduced Order Model for Turbulent Flows
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Data-driven non-Markovian closure models
• A new framework for climate sensitivity and prediction: a modelling perspective
• Extreme learning machine for reduced order modeling of turbulent geophysical flows
• Data-driven recovery of hidden physics in reduced order modeling of fluid flows
• A discrete approach to stochastic parametrization and dimensional reduction in nonlinear dynamics
• Predicting Climate Change using Response Theory: Global Averages and Spatial Patterns
• Multi-level Dynamical Systems: Connecting the Ruelle Response Theory and the Mori-Zwanzig Approach
• Data-Driven Variational Multiscale Reduced Order Models
• Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
• Disentangling multi-level systems: averaging, correlations and memory
• Reduced-space Gaussian Process Regression for Data-Driven Probabilistic Forecast of Chaotic Dynamical Systems
• Application of the t-model of optimal prediction to the estimation of the rate of decay of solutions of the Euler equations in two and three dimensions
• Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learning
• A proof of concept for scale-adaptive parameterizations: the case of the Lorenz '96 model
• Efficient Statistically Accurate Algorithms for the Fokker-Planck Equation in Large Dimensions
• Reduced-Order Models for Coupled Dynamical Systems: Data-driven Methods and the Koopman Operator
• Data-adaptive harmonic spectra and multilayer Stuart-Landau models
• Stochastic superparameterization in quasigeostrophic turbulence
• Variational approach to closure of nonlinear dynamical systems: Autonomous case
• BAMCAFE: A Bayesian Machine Learning Advanced Forecast Ensemble Method for Complex Turbulent Systems with Partial Observations
• Data-driven model reduction for stochastic Burgers equations
• Efficient Construction of Local Parametric Reduced Order Models Using Machine Learning Techniques
• Shock trace prediction by reduced models for a viscous stochastic Burgers equation
• Dimension reduction for systems with slow relaxation

Cited by in corpus (6)

• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting
• CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation
• CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation
• Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network
• A Martingale-Free Introduction to Conditional Gaussian Nonlinear Systems