Bayesian Evidence and Model Selection

Abstract

In this paper we review the concepts of Bayesian evidence and Bayes factors, also known as log odds ratios, and their application to model selection. The theory is presented along with a discussion of analytic, approximate and numerical techniques. Specific attention is paid to the Laplace approximation, variational Bayes, importance sampling, thermodynamic integration, and nested sampling and its recent variants. Analogies to statistical physics, from which many of these techniques originate, are discussed in order to provide readers with deeper insights that may lead to new techniques. The utility of Bayesian model testing in the domain sciences is demonstrated by presenting four specific practical examples considered within the context of signal processing in the areas of signal detection, sensor characterization, scientific model selection and molecular force characterization.

Arxiv version consists of 58 pages and 9 figures. Features theory, numerical methods and four applications

References in corpus (17)

• Expectation Propagation for approximate Bayesian inference
• Bayes in the sky: Bayesian inference and model selection in cosmology
• A Bayesian approach to strong lensing modelling of galaxy clusters
• Inferring Parameters and Structure of Latent Variable Models by Variational Bayes
• On model selection forecasting, Dark Energy and modified gravity
• Hunt for new phenomena using large jet multiplicities and missing transverse momentum with ATLAS in 4.7 fb^-1 of sqrt(s) = 7 TeV proton-proton collisions
• Present and future evidence for evolving dark energy
• EXONEST: Bayesian Model Selection Applied to the Detection and Characterization of Exoplanets Via Photometric Variations
• Computing Upper and Lower Bounds on Likelihoods in Intractable Networks
• An Evidence Based Search Method For Gravitational Waves From Neutron Star Ring-downs
• Exploring Multi-Modal Distributions with Nested Sampling
• Bayesian evidence for non-zero theta_13 and CP-violation in neutrino oscillations
• Delayed rejection schemes for efficient Markov-Chain Monte-Carlo sampling of multimodal distributions
• Bayesian model selection for dark energy using weak lensing forecasts
• Bayesian Model Selection for Electromagnetic Kaon Production on the Nucleon
• Ensemble annealing of complex physical systems
• Bayesian Odds-Ratio Filters: A Template-Based Method for Online Detection of P300 Evoked Responses

Cited by in corpus (29)

• Nested sampling for physical scientists
• Consistency tests in cosmology using relative entropy
• Characterization of Kepler-91b and the Investigation of a Potential Trojan Companion Using EXONEST
• LogME: Practical Assessment of Pre-trained Models for Transfer Learning
• Constraints on dark matter to dark radiation conversion in the late universe with DES-Y1 and external data
• The Gaia-ESO Survey: Dynamical Analysis of the L1688 region in Ophiuchus
• Predictable patterns in planetary transit timing variations and transit duration variations due to exomoons
• Validation of TESS exoplanet candidates orbiting solar analogues in the all-sky PLATO input catalogue
• On the safe use of prior densities for Bayesian model selection
• A Generalized Bayesian Approach to Model Calibration
• Asteroseismology of KIC 7107778: a binary comprising almost identical subgiants
• Combining Photometry From Kepler and TESS to Improve Short-Period Exoplanet Characterization
• Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
• Photometric redshifts and intrinsic alignments: degeneracies and biases in 3$\times$2pt analysis
• Model discrimination in pseudoscalar-meson photoproduction
• Multi-modal atmospheric characterization of $\beta$ Pictoris b: Adding high-resolution continuum spectra from GRAVITY
• EXONEST: The Bayesian Exoplanetary Explorer
• Analyzing Exoplanet Phase Curve Information Content: Toward Optimized Observing Strategies
• Causal, Bayesian, & Non-parametric Modeling of the SARS-CoV-2 Viral Load Distribution vs. Patient's Age
• The hot interstellar medium towards 4U 1820-30: a Bayesian analysis
• Towards fast machine-learning-assisted Bayesian posterior inference of microseismic event location and source mechanism
• Computing Entropies With Nested Sampling
• Distributed Computation for Marginal Likelihood based Model Choice
• An adaptive scheduling tool to optimize measurements to reach a scientific objective: methodology and application to the measurements of stellar orbits in the Galactic Center
• Bayesian Design of Experiments: Implementation, Validation and Application to Chemical Kinetics
• Partition function approach to non-Gaussian likelihoods: Formalism and expansions for weakly non-Gaussian cosmological inference
• Information Criterion for Boltzmann Approximation Problems
• Detecting non-thermal emission in a solar microflare using nested sampling
• Testing for a Random Walk Structure in the Frequency Evolution of a Tone in Noise