Inferring unknown unknowns: Regularized bias-aware ensemble Kalman filter

Abstract

Because of physical assumptions and numerical approximations, low-order models are affected by uncertainties in the state and parameters, and by model biases. Model biases, also known as model errors or systematic errors, are difficult to infer because they are `unknown unknowns', i.e., we do not necessarily know their functional form a priori. With biased models, data assimilation methods may be ill-posed because either (i) they are 'bias-unaware' because the estimators are assumed unbiased, (ii) they rely on an a priori parametric model for the bias, or (iii) they can infer model biases that are not unique for the same model and data. First, we design a data assimilation framework to perform combined state, parameter, and bias estimation. Second, we propose a mathematical solution with a sequential method, i.e., the regularized bias-aware ensemble Kalman Filter (r-EnKF), which requires a model of the bias and its gradient (i.e., the Jacobian). Third, we propose an echo state network as the model bias estimator. We derive the Jacobian of the network, and design a robust training strategy with data augmentation to accurately infer the bias in different scenarios. Fourth, we apply the r-EnKF to nonlinearly coupled oscillators (with and without time-delay) affected by different forms of bias. The r-EnKF infers in real-time parameters and states, and a unique bias. The applications that we showcase are relevant to acoustics, thermoacoustics, and vibrations; however, the r-EnKF opens new opportunities for combined state, parameter and bias estimation for real-time and on-the-fly prediction in nonlinear systems.

22 Figures

References in corpus (10)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
• Using machine learning to correct model error in data assimilation and forecast applications
• Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization
• Sensitivity analysis of a time-delayed thermo-acoustic system via an adjoint-based approach
• Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correction
• Synchronization by Reactive Coupling and Nonlinear Frequency Pulling
• Stability, sensitivity and optimisation of chaotic acoustic oscillations
• Real-time thermoacoustic data assimilation
• Combined State and Parameter Estimation in Level-Set Methods

Cited by in corpus (6)

• EKF-SINDy: Empowering the extended Kalman filter with sparse identification of nonlinear dynamics
• Reconstructing unsteady flows from sparse, noisy measurements with a physics-constrained convolutional neural network
• A real-time digital twin of azimuthal thermoacoustic instabilities
• Real-time forecasting of chaotic dynamics from sparse data and autoencoders
• Data-assimilated model-informed reinforcement learning
• Reconstruction of three-dimensional turbulent flows from sparse and noisy planar measurements: A weight-sharing neural network approach