Model averaging approaches to data subset selection

Abstract

Model averaging is a useful and robust method for dealing with model uncertainty in statistical analysis. Often, it is useful to consider data subset selection at the same time, in which model selection criteria are used to compare models across different subsets of the data. Two different criteria have been proposed in the literature for how the data subsets should be weighted. We compare the two criteria closely in a unified treatment based on the Kullback-Leibler divergence, and conclude that one of them is subtly flawed and will tend to yield larger uncertainties due to loss of information. Analytical and numerical examples are provided.

arXiv comment17 pages, 2 figures. v2: updated to published version

References in corpus (6)

• A high-bias, low-variance introduction to Machine Learning for physicists
• Leading hadronic contribution to the muon magnetic moment from lattice QCD
• Ab initio calculation of the neutron-proton mass difference
• Constrained Curve Fitting
• $B_{(s)}^0$-mixing matrix elements from lattice QCD for the Standard Model and beyond
• Bayesian model averaging for analysis of lattice field theory results

Cited by in corpus (11)

• Improved information criteria for Bayesian model averaging in lattice field theory
• Nucleon Sigma Terms with $N_f=2+1$ O($a$)-improved Wilson fermions
• ${\Xi }_c\to \Xi$ form factors from lattice QCD with domain-wall quarks: A new piece in the puzzle of ${\Xi }_c^0$ decay rates
• Physical-mass calculation of $\rho (770)$ and $K^{\ast }(892)$ resonance parameters via $\pi \pi$ and $K\pi$ scattering amplitudes from lattice QCD
• Deep learning of phase transitions with minimal examples
• A generalized statistical model for fits to parton distributions
• The $\pi \pi$ scattering amplitude at large $N_{\text{c}}$
• Single Particle Spectrum of Doped ${\mathrm{C}}_{20}{\mathrm{H}}_{12}$-Perylene
• ${\Xi }_b\to \Xi$ form factors from lattice QCD and Standard-Model predictions for ${\Xi }_b\to \Xi {\mu }^{+}{\mu }^{-}$ and ${\Xi }_b\to \Xi \gamma$ decays
• The two-pion contribution to the hadronic vacuum polarization with staggered quarks
• $f_K/f_{\pi }$ in iso-symmetric QCD and the CKM matrix unitarity