Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy

Abstract

Markov Chain Monte Carlo based Bayesian data analysis has now become the method of choice for analyzing and interpreting data in almost all disciplines of science. In astronomy, over the last decade, we have also seen a steady increase in the number of papers that employ Monte Carlo based Bayesian analysis. New, efficient Monte Carlo based methods are continuously being developed and explored. In this review, we first explain the basics of Bayesian theory and discuss how to set up data analysis problems within this framework. Next, we provide an overview of various Monte Carlo based methods for performing Bayesian data analysis. Finally, we discuss advanced ideas that enable us to tackle complex problems and thus hold great promise for the future. We also distribute downloadable computer software (available at https://github.com/sanjibs/bmcmc/ ) that implements some of the algorithms and examples discussed here.

49 pages, draft version, to appear in Annual Review of Astronomy and Astrophysics

References in corpus (66)

• emcee: The MCMC Hammer
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• MCMC using Hamiltonian dynamics
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• Local Kinematics and the Local Standard of Rest
• The Galaxy in Context: Structural, Kinematic and Integrated Properties
• Trigonometric Parallaxes of High Mass Star Forming Regions: the Structure and Kinematics of the Milky Way
• Bayes in the sky: Bayesian inference and model selection in cosmology
• The mass distribution and gravitational potential of the Milky Way
• Trigonometric Parallaxes of Massive Star Forming Regions: VI. Galactic Structure, Fundamental Parameters and Non-Circular Motions
• The Proper Motion of Sgr A*: II. The Mass of Sgr A*
• Mass models of the Milky Way
• The pseudo-marginal approach for efficient Monte Carlo computations
• Concentration, Spin and Shape of Dark Matter Haloes: Scatter and the Dependence on Mass and Environment
• Asteroseismology of Solar-Type and Red-Giant Stars
• A Three-Dimensional Map of Milky-Way Dust
• A direct dynamical measurement of the Milky Way's disk surface density profile, disk scale length, and dark matter profile at 4 kpc < R < 9 kpc
• The spatial structure of mono-abundance sub-populations of the Milky Way disk
• The Milky Way's circular velocity curve between 4 and 14 kpc from APOGEE data
• The Cannon: A data-driven approach to stellar label determination
• A Nested Sampling Algorithm for Cosmological Model Selection
• Ensemble Asteroseismology of Solar-Type Stars with the NASA Kepler Mission
• The radial velocity dispersion profile of the Galactic halo: Constraining the density profile of the dark halo of the Milky Way
• Asteroseismology of red giants from the first four months of Kepler data: Fundamental parameters
• Probabilistic Mass-Radius Relationship for Sub-Neptune-Sized Planets
• The Milky Way's Stellar Disk
• On the Shoulders of Giants: Properties of the Stellar Halo and the Milky Way Mass Distribution
• Inferring the eccentricity distribution
• Isochrone ages for field dwarfs: method and application to the age-metallicity relation
• Stellar population synthesis based modelling of the Milky Way using asteroseismology of 13000 Kepler red giants
• Adaptive Importance Sampling in General Mixture Classes
• Constraining the Galaxy's dark halo with RAVE stars
• Kinematics of the stellar halo and the mass distribution of the Milky Way using BHB stars
• Kinematics of SDSS subdwarfs: Structure and substructure of the Milky Way halo
• II: Bayesian Methods for Cosmological Parameter Estimation from Cosmic Microwave Background Measurements
• The chemical homogeneity of open clusters
• The cold veil of the Milky Way stellar halo
• On Correlated-noise Analyses Applied To Exoplanet Light Curves
• Kinematic modelling of the Milky Way using the RAVE and GCS stellar surveys
• Bayesian peak-bagging of solar-like oscillators using MCMC: A comprehensive guide
• A Bayesian model selection analysis of WMAP3
• The Age of the Universe and the Cosmological Constant Determined from Cosmic Microwave Background Anisotropy Measurements
• Measuring Distances and Reddenings for a Billion Stars: Towards A 3D Dust Map from Pan-STARRS 1
• New distances to RAVE stars
• RUN DMC: An efficient, parallel code for analyzing Radial Velocity Observations using N-body Integrations and Differential Evolution Markov chain Monte Carlo
• Extended distribution functions for our Galaxy
• Stellar distances from spectroscopic observations: a new technique
• An Empirically Derived Three-Dimensional Laplace Resonance in the Gliese 876 Planetary System
• Estimation of cosmological parameters using adaptive importance sampling
• Fast optimal CMB power spectrum estimation with Hamiltonian sampling
• On the detection of Lorentzian profiles in a power spectrum: A Bayesian approach using ignorance priors
• Efficient Cosmological Parameter Estimation with Hamiltonian Monte Carlo
• Distance determination for RAVE stars using stellar models III: The nature of the RAVE survey and Milky Way chemistry
• From EM to Data Augmentation: The Emergence of MCMC Bayesian Computation in the 1980s
• Analysing surveys of our Galaxy -- II. Determining the potential
• The Correlation Between Hα Emission and Visual Magnitude During Long-Term Variations in Classical Be Stars
• 3D Extinction Mapping Using Hierarchical Bayesian Models
• Dynamics for Galactic Archaeology
• Estimating the Galactic Mass Profile in the Presence of Incomplete Data
• Analysing surveys of our Galaxy I: basic astrometric data
• Bayes versus the virial theorem: inferring the potential of a galaxy from a kinematical snapshot
• NEOWISE: Observations of the Irregular Satellites of Jupiter and Saturn
• Bayesian Model Averaging in Astrophysics: A Review
• Marginal likelihoods of distances and extinctions to stars: computation and compact representation
• Extracting science from surveys of our Galaxy
• Three-dimensional extinction mapping and selection effects

Cited by in corpus (149)

• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• An introduction to Bayesian inference in gravitational-wave astronomy: parameter estimation, model selection, and hierarchical models
• Data analysis recipes: Using Markov Chain Monte Carlo
• The GALAH survey and Gaia DR2: dissecting the stellar disc's phase space by age, action, chemistry and location
• The JWST Extragalactic Mock Catalog: Modeling galaxy populations from the UV through the near-IR over thirteen billion years of cosmic history
• Fast, Slow, Early, Late: Quenching Massive Galaxies at z~0.8
• The TESS-HERMES survey Data Release 1: high-resolution spectroscopy of the TESS southern continuous viewing zone
• The GREATS H$\beta$+[OIII] Luminosity Function and Galaxy Properties at $\mathbf{z}\sim 8$: Walking the Way of JWST
• Tracing the formation of the Milky Way through ultra metal-poor stars
• The Degree of Alignment Between Circumbinary Disks and Their Binary Hosts
• Chemical Enrichment and Radial Migration in the Galactic Disk -- the origin of the [$\alpha /\mathrm{Fe}]$ Double Sequence
• ZTF Early Observations of Type Ia Supernovae I: Properties of the 2018 Sample
• Pyaneti: a fast and powerful software suite for multi-planet radial velocity and transit fitting
• Bilby-MCMC: An MCMC sampler for gravitational-wave inference
• Galactic Archaeology with asteroseismic ages. II. Confirmation of a delayed gas infall using Bayesian analysis based on MCMC methods
• Gamma-ray quasi-periodicities of blazars. A cautious approach
• The Need for Speed: Escape velocity and dynamical mass measurements of the Andromeda galaxy
• Accelerating astronomical and cosmological inference with Preconditioned Monte Carlo
• Cosmological parameter inference with Bayesian statistics
• Controllable Non-Markovianity for a Spin Qubit in Diamond
• Gravitational-wave parameter estimation with gaps in LISA: a Bayesian data augmentation method
• Evidence for diffuse molecular gas and dust in the hearts of gamma-ray burst host galaxies
• Eryn : A multi-purpose sampler for Bayesian inference
• The Relationship Between Globular Cluster Mass, Metallicity, and Light Element Abundance Variations
• Weak Lensing Reveals a Tight Connection Between Dark Matter Halo Mass and the Distribution of Stellar Mass in Massive Galaxies
• The COS CGM Compendium. II: Metallicities of the Partial and Lyman Limit Systems at z<1
• The Galactic Thick Disc density profile traced with RR Lyrae stars
• Removing degeneracy and multimodality in gravitational wave source parameters
• Looking at Blazar Light Curve Periodicities with Gaussian Processes
• Solar Bayesian Analysis Toolkit -- a new Markov chain Monte Carlo IDL code for Bayesian parameter inference
• Characterising the surface magnetic fields of T Tauri stars with high-resolution near-infrared spectroscopy
• Bayesian Coronal Seismology
• Model Comparison of $\Lambda$CDM vs $R_h=ct$ using Cosmic Chronometers
• Imprints of Mass Accretion History on the Shape of the Intracluster Medium and the $T_X-M$ Relation
• Improving constraints on the reionization parameters using 21-cm bispectrum
• Temporal Evolution of Spatially-Resolved Individual Star Spots on a Planet-Hosting Solar-type Star: Kepler 17
• Umbrella sampling: a powerful method to sample tails of distributions
• Isotopically resolved neutron total cross sections at intermediate energies
• Constraints on Yukawa gravity parameters from observations of bright stars
• Magnetic Field of the Active Planet-hosting M Dwarf AU Mic
• Model Comparison tests of modified gravity from the Eöt-Wash experiment
• Integrating light-curve and atmospheric modelling of transiting exoplanets
• [CII] halos in ALPINE galaxies: smoking-gun of galactic outflows?
• A Cosmological Underdensity Does Not Solve the Hubble Tension
• A New Method to Constrain the Appearance and Disappearance of Observed Jellyfish Galaxy Tails
• Gaia Data Release 3: spectroscopic binary-star orbital solutions. The SB1 processing chain
• Search for Lorentz Invariance Violation from stacked Gamma-Ray Burst spectral lag data
• Markov chain Monte Carlo population synthesis of single radio pulsars in the Galaxy
• Variational Inference as an alternative to MCMC for parameter estimation and model selection
• Empirical constraints on the turbulence in QSO host nebulae from velocity structure function measurements
• Systematic biases in determining dust attenuation curves through galaxy SED fitting
• The impact of non-Gaussianity on the Epoch of Reionization parameter forecast using 21-cm power spectrum measurements
• Gas Column Density Distribution of Molecular Clouds in the Third Quadrant of the Milky Way
• 21st Century Statistical and Computational Challenges in Astrophysics
• Starspot mapping with adaptive parallel tempering I: Implementation of computational code
• A Method To Characterize the Wide-Angle Point Spread Function of Astronomical Images
• Evidence for conservative mass transfer in the classical Algol system $\delta$ Librae from its surface carbon-to-nitrogen abundance ratio
• Two Dimensional Clustering of Gamma-Ray Bursts using durations and hardness
• Spatial field reconstruction with INLA: Application to IFU galaxy data
• TOI-1670 b and c: An Inner Sub-Neptune with an Outer Warm Jupiter Unlikely to have Originated from High-Eccentricity Migration
• The stepping-stone sampling algorithm for calculating the evidence of gravitational wave models
• The observable properties of cool winds from galaxies, AGN, and star clusters -- II. 3D models for the multiphase wind of M82
• Asteroseismology of the Double-Mode High-Amplitude $\delta$ Scuti Star VX Hydrae
• Decayless longitudinal oscillations of a solar filament maintained by quasi-periodic jets
• Simultaneous transverse oscillations of a coronal loop and a filament excited by a circular-ribbon flare
• Determination of small-scale magnetic fields on Sun-like stars in the near-infrared using CRIRES${}^{+}$
• Probing jet launching in neutron star X-ray binaries: the variable and polarized jet of SAX J1808.4-3658
• Measuring dust in core-collapse supernovae with a Bayesian approach to line profile modelling
• New method for Earth neutral atmospheric density retrieval based on energy spectrum fitting during occultation with LE/\emph{Insight}-HXMT
• Dark matter and lepton flavour phenomenology in a singlet-doublet scotogenic model
• Noise analysis of the Indian Pulsar Timing Array data release I
• Revisiting the Extreme Clustering of $z\approx 4$ Quasars with Large Volume Cosmological Simulations
• Momentum transfer in the dark sector and lensing convergence in upcoming galaxy surveys
• Bayesian spectral density approach for identification and uncertainty quantification of bridge section's flutter derivatives operated in turbulent flow
• K-CLASH: Strangulation and Ram Pressure Stripping in Galaxy Cluster Members at 0.3 < z < 0.6
• Time-frequency analysis assisted reconstruction of ruthenium optical constants in the sub-EUV spectral range 8nm-23.75nm
• Anatomy of parameter-estimation biases in overlapping gravitational-wave signals
• Simulating White-Light Images of Coronal Structures for Parker Solar Probe/WISPR: Study of the Total Brightness Profiles
• Detecting the periodicity of highly irregularly sampled light-curves with Gaussian processes: the case of SDSSJ025214.67-002813.7
• Magnetic field of the eclipsing binary UV Piscium
• A rapidly evolving high-amplitude $\delta$ Scuti star crossing the Hertzsprung Gap
• SLUG IV: A Novel Forward-Modelling Method to Derive the Demographics of Star Clusters
• Isolated pulsar population synthesis with simulation-based inference
• ASASSN-18aan: An Eclipsing SU UMa-type Cataclysmic Variable with a 3.6-hour Orbital Period and a Late G-type Secondary Star
• A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications
• Inference of magnetic field strength and density from damped transverse coronal waves
• Cosmological constraints with the Effective Fluid approach for Modified Gravity
• Radio data challenge the broadband modelling of GRB160131A afterglow
• Small-scale magnetic fields of the spectroscopic binary T Tauri stars V1878 Ori and V4046 Sir
• Discriminating among cosmological models by data-driven methods
• Reliable stellar abundances of individual stars with the MUSE integral-field spectrograph
• Impact of overlapping signals on parameterized post-Newtonian coefficients in tests of gravity
• Search for Lorentz Invariance Violation using Bayesian model comparison applied to Xiao et al. GRB spectral lag catalog
• Classification of Pulsar Glitch Amplitudes using Extreme Deconvolution
• Candidate List of Edge-on Galaxies with Substantial Extraplanar Dust
• Inferring solar differential rotation through normal-mode coupling using Bayesian statistics
• Measurement of the vertical atmospheric density profile from the X-ray Earth occultation of the Crab Nebula with Insight-HXMT
• Double-peaked OI profile: a likely signature of the gaseous ring around KH 15D
• Velocity distribution of elliptical galaxies in the framework of Non-local Gravity model
• The GALAH Survey: Velocity fluctuations in the Milky Way using red clump giants
• Observational Evidence of a Centi-parsec Supermassive Black Hole Binary Existing in the Nearby Galaxy M81
• A Spatially Resolved Radio Spectral Index Study of the Dwarf Irregular Galaxy NGC\,1569
• Observations of scattered light from exoplanet atmospheres
• Bayesian evidence for spectral lag transition due to Lorentz Invariance Violation for 32 Fermi/GBM Gamma-ray Bursts
• Probing the absorption of gamma-rays by IR radiation from the dusty torus in FSRQs with the Cherenkov Telescope Array
• Bayesian Analysis of the ${}^{70}$Zn$(d{,}^3\text{He}{)}^{69}$Cu Transfer Reaction
• Quiet Sun electron densities and their uncertainties derived from spectral emission line intensities
• Probabilistic Inversions for Time-Distance Helioseismology
• A multi-kiloGauss magnetic field driving the magnetospheric accretion process in EX Lupi
• Spin precession frequencies of a test gyroscope around a naked singularity and quasi-periodic oscillations
• Scrutinizing coupled vector dark energy in light of data
• An independent search for annual modulation and its significance in ANAIS-112 data
• Seeking Edge-on Galaxies with Substantial Extraplanar Dust Using a Radiative Transfer Model: Determination of the Model Parameter Uncertainties for EON_10.477_41.954 (FGC 79)
• Measuring the Orbital Parameters of Radial Velocity Systems in Mean Motion Resonance---a Case Study of HD 200964
• Vetting quark-star models with gravitational waves in the hierarchical Bayesian framework
• The GALAH survey: Multiple stars and our Galaxy. I. A comprehensive method for deriving properties of FGK binary stars
• Bayesian inference of $W$-boson mass
• Bayesian Analysis of time dependence of DAMA annual modulation amplitude
• Bayes-based orbital elements estimation in triple hierarchical stellar systems
• The ORT and the uGMRT Pulsar Monitoring Program : Pulsar Timing Irregularities & the Gaussian Process Realization
• Revisiting the Local Star-Forming Galaxies Observed in the HETDEX Pilot Survey
• A Machine Learning Approach to Integral Field Unit Spectroscopy Observations: III. Disentangling Multiple Components in Hii regions
• Gibbs Point Process Model for Young Star Clusters in M33
• Determination of Hubble constant from Megamaser Cosmology Project using Profile Likelihood
• Informative Bayesian model selection for RR Lyrae star classifiers
• Nebular Dust Attenuation with the Balmer and Paschen Lines based on the MaNGA Survey
• Probing neutral outflows in z ~ 2 galaxies using JWST observations of Ca II H and K absorption lines
• Lensing convergence and anisotropic dark energy in galaxy redshift surveys
• Testing black hole space-times with the S2 star orbit: a Bayesian comparison
• A Multi-wavelength Characterization of the 2023 Outburst of MAXI J1807+132: Manifestations of Disk Instability and Jet Emission
• The MOSDEF Survey: Probing Resolved Stellar Populations at $z\sim 2$ Using a New Bayesian-defined Morphology Metric Called Patchiness
• First application of Markov Chain Monte Carlo-based Bayesian data analysis to the Doppler-Shift Attenuation Method
• The LEGARE Project. I. Chemical evolution model of the Nuclear Stellar Disc in a Bayesian framework
• Developing Parameter-Reduction Methods on a Biophysical Model of Auditory Hair Cells
• Constraint on Lorentz Invariance Violation for spectral lag transition in GRB 160625B using profile likelihood
• The Indian Pulsar Timing Array Data Release 2: II. Customised Single-Pulsar Noise Analysis and Noise Budget
• A practical Bayesian method for gravitational-wave ringdown analysis with multiple modes
• Period-Luminosity-Metallicity-Color Relations of Late-type Contact Binaries in the Big Data Era
• Comparison of $\Lambda$CDM and $R_h=ct$ with updated galaxy cluster $f_{gas}$ measurements using Bayesian inference
• The 2025 Evaluation of Experimental Thermonuclear Reaction Rates (ETR25)
• Re-examining the Bayesian colour excess estimation for the local star-forming galaxies observed in the HETDEX Pilot Survey
• Search for Continuous Gravitational Wave Signals in Pulsar Timing Residuals: A New Scalable Approach with Diffusive Nested Sampling
• Revisiting Galaxy Cluster Scaling Relations through Dark Matter-Gas Coherence: Scatter Dependence on Dynamical State
• An independent search for Jovian neutrinos using BOREXINO data
• A Spectroscopic Modelling Method for the Detached Eclipsing Binaries to Derive Atmospheric Parameters
• Determination of the best dark matter profile for the Milky Way with Gaia DR3 using Bayesian Model Comparison
• Bayesian Model Comparison of $R_h=ct$ versus $\Lambda$CDM using HII galaxy Hubble diagram
• Search for Annual Modulation in Combined ANAIS 112 and COSINE 100 Data using Bayesian Model Comparison
• Lightweight posterior construction for gravitational-wave catalogs with the Kolmogorov-Arnold network