Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation

Abstract

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of research data-assimilation has been successfully used to optimally combine forecast models and their inherent uncertainty with incoming noisy observations. The key idea in our work here is to achieve increased forecast capabilities by judiciously combining machine-learning algorithms and data assimilation. We combine the physics-agnostic data-driven approach of random feature maps as a forecast model within an ensemble Kalman filter data assimilation procedure. The machine-learning model is learned sequentially by incorporating incoming noisy observations. We show that the obtained forecast model has remarkably good forecast skill while being computationally cheap once trained. Going beyond the task of forecasting, we show that our method can be used to generate reliable ensembles for probabilistic forecasting as well as to learn effective model closure in multi-scale systems.

References in corpus (24)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
• Solving high-dimensional partial differential equations using deep learning
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Deep learning to represent sub-grid processes in climate models
• A Mean Field View of the Landscape of Two-Layers Neural Networks
• On Particle Methods for Parameter Estimation in State-Space Models
• De-Biasing the Dynamic Mode Decomposition for Applied Koopman Spectral Analysis
• Breaking the Curse of Dimensionality with Convex Neural Networks
• Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model
• Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
• Data Assimilation: A Mathematical Introduction
• A Priori Estimates of the Population Risk for Two-layer Neural Networks
• Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization
• On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport
• Uniformly Accurate Machine Learning Based Hydrodynamic Models for Kinetic Equations
• Operator-valued Kernels for Learning from Functional Response Data
• Reservoir Computing as a Tool for Climate Predictability Studies
• Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't
• Online learning of both state and dynamics using ensemble Kalman filters
• EM-like Learning Chaotic Dynamics from Noisy and Partial Observations
• Automatic Differentiation to Simultaneously Identify Nonlinear Dynamics and Extract Noise Probability Distributions from Data
• Combining data assimilation and machine learning to infer unresolved scale parametrisation
• Stochastically perturbed bred vectors in multi-scale systems

Cited by in corpus (11)

• Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
• Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations
• Reservoir Computing as a Tool for Climate Predictability Studies
• State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics
• Supervised machine learning to estimate instabilities in chaotic systems: estimation of local Lyapunov exponents
• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting
• Development of an offline and online hybrid model for the Integrated Forecasting System
• Robust parameter estimation using the ensemble Kalman filter
• Rough McKean-Vlasov dynamics for robust ensemble Kalman filtering
• Fourier Series-Based Approximation of Time-Varying Parameters in Ordinary Differential Equations