A Conceptual Introduction to Markov Chain Monte Carlo Methods
arXiv:1909.12313
Abstract
Markov Chain Monte Carlo (MCMC) methods have become a cornerstone of many modern scientific analyses by providing a straightforward approach to numerically estimate uncertainties in the parameters of a model using a sequence of random samples. This article provides a basic introduction to MCMC methods by establishing a strong conceptual understanding of what problems MCMC methods are trying to solve, why we want to use them, and how they work in theory and in practice. To develop these concepts, I outline the foundations of Bayesian inference, discuss how posterior distributions are used in practice, explore basic approaches to estimate posterior-based quantities, and derive their link to Monte Carlo sampling and MCMC. Using a simple toy problem, I then demonstrate how these concepts can be used to understand the benefits and drawbacks of various MCMC approaches. Exercises designed to highlight various concepts are also included throughout the article.
54 pages, 15 figures. Comments and feedback always appreciated
Cited by in corpus (10)
- Galactic Archaeology with asteroseismic ages. II. Confirmation of a delayed gas infall using Bayesian analysis based on MCMC methods
- zeus: A Python implementation of Ensemble Slice Sampling for efficient Bayesian parameter inference
- Hot QCD Phase Diagram From Holographic Einstein-Maxwell-Dilaton Models
- Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
- Trial by FIRE: Probing the dark matter density profile of dwarf galaxies with GraphNPE
- Bayesian Quantum Amplitude Estimation
- eBASCS: Disentangling Overlapping Astronomical Sources II, using Spatial, Spectral, and Temporal Information
- On the Binary Nature of the Progenitor of SN2015ap: Insights from Its Light Curve and Spectral Evolution
- From Global Climate Models (GCMs) to Exoplanet Spectra with the Global Emission Spectra (GlobES)
- Using Computational Models to Uncover the Parameters of Three Kepler Binaries: KIC 5957123, KIC 8314879, and KIC 10727668