Adaptive Tikhonov strategies for stochastic ensemble Kalman inversion

Abstract

Ensemble Kalman inversion (EKI) is a derivative-free optimizer aimed at solving inverse problems, taking motivation from the celebrated ensemble Kalman filter. The purpose of this article is to consider the introduction of adaptive Tikhonov strategies for EKI. This work builds upon Tikhonov EKI (TEKI) which was proposed for a fixed regularization constant. By adaptively learning the regularization parameter, this procedure is known to improve the recovery of the underlying unknown. For the analysis, we consider a continuous-time setting where we extend known results such as well-posdeness and convergence of various loss functions, but with the addition of noisy observations. Furthermore, we allow a time-varying noise and regularization covariance in our presented convergence result which mimic adaptive regularization schemes. In turn we present three adaptive regularization schemes, which are highlighted from both the deterministic and Bayesian approaches for inverse problems, which include bilevel optimization, the MAP formulation and covariance learning. We numerically test these schemes and the theory on linear and nonlinear partial differential equations, where they outperform the non-adaptive TEKI and EKI.

References in corpus (18)

• The Ensemble Kalman Filter for Inverse Problems
• Derivative-free optimization methods
• Data Assimilation: A Mathematical Introduction
• Calibrate, Emulate, Sample
• Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks
• A regularizing iterative ensemble Kalman method for PDE-constrained inverse problems
• Parameterizations for Ensemble Kalman Inversion
• Adversarial Regularizers in Inverse Problems
• Well Posedness and Convergence Analysis of the Ensemble Kalman Inversion
• Ensemble Kalman Inversion: mean-field limit and convergence analysis
• Ensemble Kalman Sampler: mean-field limit and convergence analysis
• Data driven regularization by projection
• A Bi-fidelity Ensemble Kalman Method for PDE-Constrained Inverse Problems
• On convergence rates of adaptive ensemble Kalman inversion for linear ill-posed problems
• Analysis of Hierarchical Ensemble Kalman Inversion
• Ensemble Kalman filter for neural network based one-shot inversion
• Convergence Acceleration of Ensemble Kalman Inversion in Nonlinear Settings
• Consistency analysis of bilevel data-driven learning in inverse problems

Cited by in corpus (2)

• Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models
• Subsampling in ensemble Kalman inversion