Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network

Abstract

A discrete-time conditional Gaussian Koopman network (CGKN) is developed in this work to learn surrogate models that can perform efficient state forecast and data assimilation (DA) for high-dimensional complex dynamical systems, e.g., systems governed by nonlinear partial differential equations (PDEs). Focusing on nonlinear partially observed systems that are common in many engineering and earth science applications, this work exploits Koopman embedding to discover a proper latent representation of the unobserved system states, such that the dynamics of the latent states are conditional linear, i.e., linear with the given observed system states. The modeled system of the observed and latent states then becomes a conditional Gaussian system, for which the posterior distribution of the latent states is Gaussian and can be efficiently evaluated via analytical formulae. The analytical formulae of DA facilitate the incorporation of DA performance into the learning process of the modeled system, which leads to a framework that unifies scientific machine learning (SciML) and data assimilation. The performance of discrete-time CGKN is demonstrated on several canonical problems governed by nonlinear PDEs with intermittency and turbulent features, including the viscous Burgers' equation, the Kuramoto-Sivashinsky equation, and the 2-D Navier-Stokes equations, with which we show that the discrete-time CGKN framework achieves comparable performance as the state-of-the-art SciML methods in state forecast and provides efficient and accurate DA results. The discrete-time CGKN framework also serves as an example to illustrate unifying the development of SciML models and their other outer-loop applications such as design optimization, inverse problems, and optimal control.

References in corpus (36)

• Auto-Encoding Variational Bayes
• Denoising Diffusion Probabilistic Models
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Turbulence Modeling in the Age of Data
• Deep learning for universal linear embeddings of nonlinear dynamics
• Score-Based Generative Modeling through Stochastic Differential Equations
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• Applied Koopmanism
• The GNAT method for nonlinear model reduction: effective implementation and application to computational fluid dynamics and turbulent flows
• A Physics Informed Machine Learning Approach for Reconstructing Reynolds Stress Modeling Discrepancies Based on DNS Data
• KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics
• A Comprehensive Physics-Informed Machine Learning Framework for Predictive Turbulence Modeling
• Physics-Informed Machine Learning Approach for Augmenting Turbulence Models: A Comprehensive Framework
• Simulation-based optimal Bayesian experimental design for nonlinear systems
• The Ensemble Kalman Filter for Inverse Problems
• Stochastic Parameterization: Towards a new view of Weather and Climate Models
• Data-Driven POD-Galerkin Reduced Order Model for Turbulent Flows
• Sparse Dynamics for Partial Differential Equations
• Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems
• Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability
• Data-Driven Variational Multiscale Reduced Order Models
• Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
• Efficient Statistically Accurate Algorithms for the Fokker-Planck Equation in Large Dimensions
• Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems
• On the Koopman operator of algorithms
• State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics
• Extended Dynamic Mode Decomposition for Inhomogeneous Problems
• Localization in Ensemble Kalman inversion
• Generative Learning of the Solution of Parametric Partial Differential Equations Using Guided Diffusion Models and Virtual Observations
• Conditional Gaussian Nonlinear System: a Fast Preconditioner and a Cheap Surrogate Model For Complex Nonlinear Systems
• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methods
• CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting
• CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation
• CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation
• A Closed-Form Nonlinear Data Assimilation Algorithm for Multi-Layer Flow Fields

Cited by in corpus (2)

• Uncertainty Propagation Networks for Neural Ordinary Differential Equations
• Active Learning of Model Discrepancy with Bayesian Experimental Design