Improved information criteria for Bayesian model averaging in lattice field theory

Abstract

Bayesian model averaging is a practical method for dealing with uncertainty due to model specification. Use of this technique requires the estimation of model probability weights. In this work, we revisit the derivation of estimators for these model weights. Use of the Kullback-Leibler divergence as a starting point leads naturally to a number of alternative information criteria suitable for Bayesian model weight estimation. We explore three such criteria, known to the statistics literature before, in detail: a Bayesian analogue of the Akaike information criterion which we call the BAIC, the Bayesian predictive information criterion (BPIC), and the posterior predictive information criterion (PPIC). We compare the use of these information criteria in numerical analysis problems common in lattice field theory calculations. We find that the PPIC has the most appealing theoretical properties and can give the best performance in terms of model-averaging uncertainty, particularly in the presence of noisy data, while the BAIC is a simple and reliable alternative.

arXiv comment70 pages, 13 figures. v2: corrections to data subset formulas for BPIC and PPIC; edits for clarity. v3: updated to journal version

References in corpus (29)

• A high-bias, low-variance introduction to Machine Learning for physicists
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• Leading hadronic contribution to the muon magnetic moment from lattice QCD
• Philosophy and the practice of Bayesian statistics
• Ab initio calculation of the neutron-proton mass difference
• Nonlinear shrinkage estimation of large-dimensional covariance matrices
• Bayesian model averaging: A systematic review and conceptual classification
• Constrained Curve Fitting
• A percent-level determination of the nucleon axial coupling from Quantum Chromodynamics
• $B_{(s)}^0$-mixing matrix elements from lattice QCD for the Standard Model and beyond
• Adaptive Multidimensional Integration: VEGAS Enhanced
• Bayesian model averaging for analysis of lattice field theory results
• Nonperturbative investigations of SU(3) gauge theory with eight dynamical flavors
• Get on the BAND Wagon: A Bayesian Framework for Quantifying Model Uncertainties in Nuclear Dynamics
• Update: Accurate Determinations of alpha_s from Realistic Lattice QCD
• Bayesian Methods for Parameter Estimation in Effective Field Theories
• The Jeffreys-Lindley Paradox and Discovery Criteria in High Energy Physics
• Lattice QCD at the physical point meets SU(2) chiral perturbation theory
• Lattice QCD determination of neutron-antineutron matrix elements with physical quark masses
• Charged multi-hadron systems in lattice QCD+QED
• $F_K/F_{\pi }$ from Möbius domain-wall fermions solved on gradient-flowed HISQ ensembles
• On the Statistics of Baryon Correlation Functions in Lattice QCD
• On optimal truncation of divergent series solutions of nonlinear differential systems; Berry smoothing
• Sign problems, noise, and chiral symmetry breaking in a QCD-like theory
• D-meson semileptonic decays to pseudoscalars from four-flavor lattice QCD
• Bayesian Model Averaging in Astrophysics: A Review
• Model averaging approaches to data subset selection
• Relative Scales of the GUT and Twin Sectors in an F-theory model
• Does Bayesian Model Averaging improve polynomial extrapolations? Two toy problems as tests

Cited by in corpus (11)

• Precision calculation of the electromagnetic radii of the proton and neutron from lattice QCD
• Electromagnetic form factors of the nucleon from $N_f=2+1$ lattice QCD
• Investigation of pion-nucleon contributions to nucleon matrix elements
• Deep learning of phase transitions with minimal examples
• Kaon radiative leptonic decay rates from lattice QCD simulations at the physical point
• A generalized statistical model for fits to parton distributions
• Zemach and Friar radii of the proton and neutron from lattice QCD
• The $\pi \pi$ scattering amplitude at large $N_{\text{c}}$
• Single Particle Spectrum of Doped ${\mathrm{C}}_{20}{\mathrm{H}}_{12}$-Perylene
• The determination of potential scales in 2+1 flavor QCD
• Proton and neutron electromagnetic form factors from lattice QCD in the continuum limit