Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization

Abstract

The reconstruction from observations of high-dimensional chaotic dynamics such as geophysical flows is hampered by (i) the partial and noisy observations that can realistically be obtained, (ii) the need to learn from long time series of data, and (iii) the unstable nature of the dynamics. To achieve such inference from the observations over long time series, it has been suggested to combine data assimilation and machine learning in several ways. We show how to unify these approaches from a Bayesian perspective using expectation-maximization and coordinate descents. In doing so, the model, the state trajectory and model error statistics are estimated all together. Implementations and approximations of these methods are discussed. Finally, we numerically and successfully test the approach on two relevant low-order chaotic models with distinct identifiability.

Cited by in corpus (17)

• Using machine learning to correct model error in data assimilation and forecast applications
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• Learning Variational Data Assimilation Models and Solvers
• Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation
• Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows
• Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation
• Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations
• Inferring unknown unknowns: Regularized bias-aware ensemble Kalman filter
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components
• Online learning of both state and dynamics using ensemble Kalman filters
• State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics
• Synchronizing subgrid scale models of turbulence to data
• Model selection of chaotic systems from data with hidden variables using sparse data assimilation
• 3D-Var Data Assimilation using a Variational Autoencoder
• Machine learning for online sea ice bias correction within global ice-ocean simulations
• BAMCAFE: A Bayesian Machine Learning Advanced Forecast Ensemble Method for Complex Turbulent Systems with Partial Observations
• Development of an offline and online hybrid model for the Integrated Forecasting System