Data-driven non-Markovian closure models

Abstract

This paper has two interrelated foci: (i) obtaining stable and efficient data-driven closure models by using a multivariate time series of partial observations from a large-dimensional system; and (ii) comparing these closure models with the optimal closures predicted by the Mori-Zwanzig (MZ) formalism of statistical physics. Multilayer stochastic models (MSMs) are introduced as both a generalization and a time-continuous limit of existing multilevel, regression-based approaches to closure in a data-driven setting; these approaches include empirical model reduction (EMR), as well as more recent multi-layer modeling. It is shown that the multilayer structure of MSMs can provide a natural Markov approximation to the generalized Langevin equation (GLE) of the MZ formalism. A simple correlation-based stopping criterion for an EMR-MSM model is derived to assess how well it approximates the GLE solution. Sufficient conditions are derived on the structure of the nonlinear cross-interactions between the constitutive layers of a given MSM to guarantee the existence of a global random attractor. This existence ensures that no blow-up can occur for a very broad class of MSM applications, a class that includes non-polynomial predictors and nonlinearities that do not necessarily preserve quadratic energy invariants. The approach is applied to conceptual nonlinear models borrowed from climate dynamics and population dynamics. In both cases, it is shown that the resulting closure models are able to capture the main statistical features of the dynamics, even in presence of weak time-scale separation.

47 pages, 7 figures

References in corpus (9)

• Applied Koopmanism
• Random attractors for a class of stochastic partial differential equations driven by general additive noise
• Multi-level Dynamical Systems: Connecting the Ruelle Response Theory and the Mori-Zwanzig Approach
• Invariant Measures for Dissipative Dynamical Systems: Abstract Results and Applications
• A Note on Diffusion Limits of Chaotic Skew Product Flows
• Application of the t-model of optimal prediction to the estimation of the rate of decay of solutions of the Euler equations in two and three dimensions
• A comparative study of two stochastic mode reduction methods
• Problem reduction, renormalization, and memory
• Sparse model from optimal nonuniform embedding of time series

Cited by in corpus (47)

• The Physics of Climate Variability and Climate Change
• A discrete approach to stochastic parametrization and dimensional reduction in nonlinear dynamics
• Physically-Constrained Data-Driven, Filtered Reduced Order Modeling of Fluid Flows
• Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
• An early warning indicator for atmospheric blocking events using transfer operators
• Machine Learning for Prediction with Missing Dynamics
• Reduced-Order Models for Coupled Dynamical Systems: Data-driven Methods and the Koopman Operator
• Data-adaptive harmonic spectra and multilayer Stuart-Landau models
• Crisis of the Chaotic Attractor of a Climate Model: A Transfer Operator Approach
• Theoretical tools for understanding the climate crisis from Hasselmann's program and beyond
• Noise and dissipation on coadjoint orbits
• Applications of large deviation theory in geophysical fluid dynamics and climate science
• Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems
• Variational approach to closure of nonlinear dynamical systems: Autonomous case
• Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part I: Theory
• Response and Sensitivity Using Markov Chains
• Data-Driven Correction Reduced Order Models for the Quasi-Geostrophic Equations: A Numerical Investigation
• Neural Closure Models for Dynamical Systems
• Comparison of continuous and discrete-time data-based modeling for hypoelliptic systems
• Deep learning delay coordinate dynamics for chaotic attractors from partial observable data
• Data-driven PDE discovery with evolutionary approach
• Warning signs for non-Markovian bifurcations: colour blindness and scaling laws
• Conditional Gaussian Nonlinear System: a Fast Preconditioner and a Cheap Surrogate Model For Complex Nonlinear Systems
• Detecting and Attributing Change in Climate and Complex Systems: Foundations, Green's Functions, and Nonlinear Fingerprints
• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• Data-driven model reduction for stochastic Burgers equations
• Modeling of Missing Dynamical Systems: Deriving Parametric Models using a Nonparametric Framework
• Dimension reduction of noisy interacting systems
• Colored-LIM: A Data-Driven Method for Studying Dynamical Systems with Temporally Correlated Stochasticity
• A stochastic SPOD-Galerkin model for broadband turbulent flows
• Arnold maps with noise: Differentiability and non-monotonicity of the rotation number
• Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction
• Data-Driven Filtered Reduced Order Modeling Of Fluid Flows
• Bridging Gaps in the Climate Observation Network: A Physics-based Nonlinear Dynamical Interpolation of Lagrangian Ice Floe Measurements via Data-Driven Stochastic Models
• A Bayesian approach to regional decadal predictability: Sparse parameter estimation in high-dimensional linear inverse models of high-latitude sea surface temperature variability
• Stochastic Climate Theory
• Memory-based reduced modelling and data-based estimation of opinion spreading
• Multi-objective discovery of PDE systems using evolutionary approach
• Dimension reduction for systems with slow relaxation
• Data-based stochastic model reduction for the Kuramoto--Sivashinsky equation
• Physics-aware, probabilistic model order reduction with guaranteed stability
• Assessing the Suitability of the Langevin Equation for Analyzing Measured Data Through Downsampling
• Introduction to the Special Issue on the Statistical Mechanics of Climate
• Kolmogorov Modes and Linear Response of Jump-Diffusion Models
• A comparison of data-driven approaches to build low-dimensional ocean models
• NySALT: Nyström-type inference-based schemes adaptive to large time-stepping
• Noise-driven Topological Changes in Chaotic Dynamics