The Ensemble Kalman Filter for Inverse Problems

Abstract

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application domains because of its robustness and ease of implementation, and numerical evidence of its accuracy. In this paper we propose the application of an iterative ensemble Kalman method for the solution of a wide class of inverse problems. In this context we show that the estimate of the unknown function that we obtain with the ensemble Kalman method lies in a subspace A spanned by the initial ensemble. Hence the resulting error may be bounded above by the error found from the best approximation in this subspace. We provide numerical experiments which compare the error incurred by the ensemble Kalman method for inverse problems with the error of the best approximation in A, and with variants on traditional least-squares approaches, restricted to the subspace A. In so doing we demonstrate that the ensemble Kalman method for inverse problems provides a derivative-free optimization method with comparable accuracy to that achieved by traditional least-squares approaches. Furthermore, we also demonstrate that the accuracy is of the same order of magnitude as that achieved by the best approximation. Three examples are used to demonstrate these assertions: inversion of a compact linear operator; inversion of piezometric head to determine hydraulic conductivity in a Darcy model of groundwater flow; and inversion of Eulerian velocity measurements at positive times to determine the initial condition in an incompressible fluid.

Cited by in corpus (107)

• Turbulence Modeling in the Age of Data
• Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulations
• Quantifying and Reducing Model-Form Uncertainties in Reynolds-Averaged Navier-Stokes Simulations: A Data-Driven, Physics-Based Bayesian Approach
• Calibrate, Emulate, Sample
• Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks
• A regularizing iterative ensemble Kalman method for PDE-constrained inverse problems
• Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM
• Parameterizations for Ensemble Kalman Inversion
• Regularized Ensemble Kalman Methods for Inverse Problems
• Ensemble Kalman Methods With Constraints
• A Bayesian Calibration-Prediction Method for Reducing Model-Form Uncertainties with Application in RANS Simulations
• Well Posedness and Convergence Analysis of the Ensemble Kalman Inversion
• Structural engineering from an inverse problems perspective
• Mean-flow Data Assimilation based on minimal correction of turbulence models: application to turbulent high-Reynolds number backward-facing step
• Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems
• Data-Driven CFD Modeling of Turbulent Flows Through Complex Structures
• Bayesian inversion in resin transfer molding
• Ensemble Kalman Inversion: mean-field limit and convergence analysis
• On the geometry of Stein variational gradient descent
• Ensemble Kalman Sampler: mean-field limit and convergence analysis
• Evaluation of ensemble methods for quantifying uncertainties in steady-state CFD applications with small ensemble sizes
• Parameter uncertainty quantification in an idealized GCM with a seasonal cycle
• HomPINNs: homotopy physics-informed neural networks for solving the inverse problems of nonlinear differential equations with multiple solutions
• Data-augmented modeling of intracranial pressure
• Explainable Offline-Online Training of Neural Networks for Parameterizations: A 1D Gravity Wave-QBO Testbed in the Small-data Regime
• Localization in Ensemble Kalman inversion
• A Bi-fidelity Ensemble Kalman Method for PDE-Constrained Inverse Problems
• On the continuous time limit of the Ensemble Kalman Filter
• On the Mathematical Theory of Ensemble (Linear-Gaussian) Kalman-Bucy Filtering
• Adaptive Tikhonov strategies for stochastic ensemble Kalman inversion
• A two-stage ensemble Kalman filter based on multiscale model reduction for inverse problems in time fractional diffusion-wave equations
• Enforcing Boundary Conditions on Physical Fields in Bayesian Inversion
• Site characterization at downhole arrays by joint inversion of dispersion data and acceleration time series
• Never look back - A modified EnKF method and its application to the training of neural networks without back propagation
• On One-Dimensional Riccati Diffusions
• Non-Asymptotic Analysis of Ensemble Kalman Updates: Effective Dimension and Localization
• Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methods
• Phase-resolved ocean wave forecast with simultaneous current estimation through data assimilation
• Ensemble Kalman Inversion for nonlinear problems: weights, consistency, and variance bounds
• Ensemble-marginalized Kalman filter for linear time-dependent PDEs with noisy boundary conditions: Application to heat transfer in building walls
• Continuous Limits for Constrained Ensemble Kalman Filter
• Ensemble Kalman Inversion for General Likelihoods
• On convergence rates of adaptive ensemble Kalman inversion for linear ill-posed problems
• Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models
• Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features
• An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
• Ensemble Kalman filter for multiscale inverse problems
• Exploring hyper-parameter spaces of neuroscience models on high performance computers with Learning to Learn
• Ensemble Kalman Filters with Resampling
• Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network
• Analysis of Hierarchical Ensemble Kalman Inversion
• Distance-learning For Approximate Bayesian Computation To Model a Volcanic Eruption
• Subsampling in ensemble Kalman inversion
• Dropout Ensemble Kalman inversion for high dimensional inverse problems
• Inversion of Tsunamis Characteristics from Sediment Deposits Based on Ensemble Kalman Filtering
• Wasserstein stability estimates for covariance-preconditioned Fokker-Planck equations
• Ensemble Variational Fokker-Planck Methods for Data Assimilation
• On the Incorporation of Box-Constraints for Ensemble Kalman Inversion
• Improve Unscented Kalman Inversion With Low-Rank Approximation and Reduced-Order Model
• Random Coordinate Langevin Monte Carlo
• An adaptive multi-fidelity PC-based ensemble Kalman inversion for inverse problems
• Active Learning of Model Discrepancy with Bayesian Experimental Design
• Are Discrepancies in RANS Modeled Reynolds Stresses Random?
• Quantifying Model Form Uncertainty in RANS Simulation of Wing-Body Junction Flow
• Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
• Nesterov Acceleration for Ensemble Kalman Inversion and Variants
• Generalised Particle Filters with Gaussian Mixtures
• Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach
• Application of ensemble transform data assimilation methods for parameter estimation in reservoir modelling
• Quantification of Model Uncertainty in RANS Simulations: A Review
• Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
• Random Coordinate Underdamped Langevin Monte Carlo
• Improving the Convergence of the Iterative Ensemble Kalman Filter by Resampling
• A parametric Bayesian level set approach for acoustic source identification using multiple frequency information
• Fourier Series-Based Approximation of Time-Varying Parameters in Ordinary Differential Equations
• Scaling Up Bayesian Uncertainty Quantification for Inverse Problems using Deep Neural Networks
• Solving continuum and rarefied flows using differentiable programming
• Unscented Kalman Inversion: Efficient Gaussian Approximation to the Posterior Distribution
• Assimilation of disparate data for enhanced reconstruction of turbulent mean flows
• A Langevinized Ensemble Kalman Filter for Large-Scale Static and Dynamic Learning
• Constrained Ensemble Langevin Monte Carlo
• Ensemble-Based Experimental Design for Targeting Data Acquisition to Inform Climate Models
• On Unifying Randomized Methods For Inverse Problems
• Sequential Kalman Tuning of the $t$-preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems
• Uniform-in-time propagation of chaos for the Cucker--Smale model
• Data Assimilation With An Integral-Form Ensemble Square-Root Filter
• Sampling error correction in ensemble Kalman inversion
• A strongly convergent numerical scheme from Ensemble Kalman inversion
• Adaptive regularisation for ensemble Kalman inversion
• Iterative regularization for ensemble data assimilation in reservoir models
• Local sensitivity analysis for Bayesian inverse problems
• Learning landmark geodesics using Kalman ensembles
• Ensemble Kalman Filters for reliability estimation in perfusion inference
• Ensemble gradient for learning turbulence models from indirect observations
• A non-intrusive reduced basis EKI for time-fractional diffusion inverse problems
• On the asymptotical regularization for linear inverse problems in presence of white noise
• An extended sampling-ensemble Kalman filter approach for partial data inverse elastic problems
• Convergence Analysis of Ensemble Kalman Inversion: The Linear, Noisy Case
• An ensemble Kalman filter approach based on level set parameterization for acoustic source identification using multiple frequency information
• Forecast error growth: A dynamic-stochastic model
• Wind farm yaw control set-point optimization under model parameter uncertainty
• Preserving linear invariants in ensemble filtering methods
• EnKSGD: A Class Of Preconditioned Black Box Optimization And Inversion Algorithms
• Inverse $t$-source problem and a strict positivity property for coupled subdiffusion systems
• Variance reduction for Random Coordinate Descent-Langevin Monte Carlo
• DAFI: An Open-Source Framework for Ensemble-Based Data Assimilation and Field Inversion
• Ensemble-Based Data Assimilation for Material Model Characterization in High-Velocity Impact