Improve Unscented Kalman Inversion With Low-Rank Approximation and Reduced-Order Model

Abstract

The unscented Kalman inversion (UKI) presented in [1] is a general derivative-free approach to solving the inverse problem. UKI is particularly suitable for inverse problems where the forward model is given as a black box and may not be differentiable. The regularization strategy and convergence property of the UKI are thoroughly studied, and the method is demonstrated effectively handling noisy observation data and solving chaotic inverse problems. In this paper, we aim to make the UKI more efficient in terms of computational and memory costs for large scale inverse problems. We take advantages of the low-rank covariance structure to reduce the number of forward problem evaluations and the memory cost, related to the need to propagate large covariance matrices. And we leverage reduced-order model techniques to further speed up these forward evaluations. The effectiveness of the enhanced UKI is demonstrated on a barotropic model inverse problem with O($10^5$) unknown parameters and a 3D generalized circulation model (GCM) inverse problem, where each iteration is as efficient as that of gradient-based optimization methods.

arXiv comment27 pages, 9 figures

References in corpus (13)

• The GNAT method for nonlinear model reduction: effective implementation and application to computational fluid dynamics and turbulent flows
• Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
• The Ensemble Kalman Filter for Inverse Problems
• Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems
• Learning Constitutive Relations from Indirect Observations Using Deep Neural Networks
• Learning Constitutive Relations using Symmetric Positive Definite Neural Networks
• Calibrate, Emulate, Sample
• Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks
• The Random Feature Model for Input-Output Maps between Banach Spaces
• Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM
• Ensemble Kalman Methods With Constraints
• High-order, linearly stable, partitioned solvers for general multiphysics problems based on implicit-explicit Runge-Kutta schemes
• High-order partitioned spectral deferred correction solvers for multiphysics problems

Cited by in corpus (2)

• Unscented Kalman Inversion: Efficient Gaussian Approximation to the Posterior Distribution
• Bayesian Calibration for Large-Scale Fluid Structure Interaction Problems Under Embedded/Immersed Boundary Framework