Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM

Abstract

Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that allow uncertainty quantification are too expensive for climate models; they are also not robust in the presence of internal climate variability. For example, Markov chain Monte Carlo (MCMC) methods typically require $O(10^5)$ model runs and are sensitive to internal variability noise, rendering them infeasible for climate models. Here we demonstrate an approach to model calibration and uncertainty quantification that requires only $O(10^2)$ model runs and can accommodate internal climate variability. The approach consists of three stages: (i) a calibration stage uses variants of ensemble Kalman inversion to calibrate a model by minimizing mismatches between model and data statistics; (ii) an emulation stage emulates the parameter-to-data map with Gaussian processes (GP), using the model runs in the calibration stage for training; (iii) a sampling stage approximates the Bayesian posterior distributions by sampling the GP emulator with MCMC. We demonstrate the feasibility and computational efficiency of this calibrate-emulate-sample (CES) approach in a perfect-model setting. Using an idealized general circulation model, we estimate parameters in a simple convection scheme from synthetic data generated with the model. The CES approach generates probability distributions of the parameters that are good approximations of the Bayesian posteriors, at a fraction of the computational cost usually required to obtain them. Sampling from this approximate posterior allows the generation of climate predictions with quantified parametric uncertainties.

References in corpus (14)

• Scikit-learn: Machine Learning in Python
• General state space Markov chains and MCMC algorithms
• Water vapor and the dynamics of climate changes
• The Ensemble Kalman Filter for Inverse Problems
• Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulations
• Calibrate, Emulate, Sample
• The Random Feature Model for Input-Output Maps between Banach Spaces
• Well-Posedness And Accuracy Of The Ensemble Kalman Filter In Discrete And Continuous Time
• A regularizing iterative ensemble Kalman method for PDE-constrained inverse problems
• Changes in zonal surface temperature gradients and Walker circulations in a wide range of climates
• Long-time stability and accuracy of the ensemble Kalman-Bucy filter for fully observed processes and small measurement noise
• An iterative ensemble Kalman filter in presence of additive model error
• Ensemble Kalman Inversion for Sparse Learning of Dynamical Systems from Time-Averaged Data
• Ensemble Inference Methods for Models With Noisy and Expensive Likelihoods

Cited by in corpus (12)

• Calibrate, Emulate, Sample
• Stable a posteriori LES of 2D turbulence using convolutional neural networks: Backscattering analysis and generalization to higher Re via transfer learning
• Are General Circulation Models obsolete?
• Parameter uncertainty quantification in an idealized GCM with a seasonal cycle
• Semi-automatic tuning of coupled climate models with multiple intrinsic timescales: lessons learned from the Lorenz96 model
• Hyperparameter Optimization for Randomized Algorithms: A Case Study on Random Features
• Interpretable structural model error discovery from sparse assimilation increments using spectral bias-reduced neural networks: A quasi-geostrophic turbulence test case
• Improve Unscented Kalman Inversion With Low-Rank Approximation and Reduced-Order Model
• An efficient estimation of time-varying parameters of dynamic models by combining offline batch optimization and online data assimilation
• Unscented Kalman Inversion: Efficient Gaussian Approximation to the Posterior Distribution
• Ensemble-Based Experimental Design for Targeting Data Acquisition to Inform Climate Models
• Fast Posterior Estimation of Cardiac Electrophysiological Model Parameters via Bayesian Active Learning