A Repelling-Attracting Metropolis Algorithm for Multimodality

Abstract

Although the Metropolis algorithm is simple to implement, it often has difficulties exploring multimodal distributions. We propose the repelling-attracting Metropolis (RAM) algorithm that maintains the simple-to-implement nature of the Metropolis algorithm, but is more likely to jump between modes. The RAM algorithm is a Metropolis-Hastings algorithm with a proposal that consists of a downhill move in density that aims to make local modes repelling, followed by an uphill move in density that aims to make local modes attracting. The downhill move is achieved via a reciprocal Metropolis ratio so that the algorithm prefers downward movement. The uphill move does the opposite using the standard Metropolis ratio which prefers upward movement. This down-up movement in density increases the probability of a proposed move to a different mode. Because the acceptance probability of the proposal involves a ratio of intractable integrals, we introduce an auxiliary variable which creates a term in the acceptance probability that cancels with the intractable ratio. Using several examples, we demonstrate the potential for the RAM algorithm to explore a multimodal distribution more efficiently than a Metropolis algorithm and with less tuning than is commonly required by tempering-based methods.

References in corpus (3)

• The pseudo-marginal approach for efficient Monte Carlo computations
• Bayesian Estimates of Astronomical Time Delays between Gravitationally Lensed Stochastic Light Curves
• Delayed rejection schemes for efficient Markov-Chain Monte-Carlo sampling of multimodal distributions

Cited by in corpus (12)

• Modeling Stochastic Variability in Multi-Band Time Series Data
• Rapid Optical Variations Correlated with X-rays in the 2015 Second Outburst of V404 Cygni (GS 2023$+$338)
• TD-CARMA: Painless, accurate, and scalable estimates of gravitational-lens time delays with flexible CARMA processes
• Bit Blasting Probabilistic Programs
• An Empirical Bayesian Approach to Limb-darkening in Modeling WASP-121b Transit Light Curves
• Nested Sampling for Non-Gaussian Inference in SLAM Factor Graphs
• Pseudo-extended Markov chain Monte Carlo
• Six Maxims of Statistical Acumen for Astronomical Data Analysis
• Conducting Highly Principled Data Science: A Statistician's Job and Joy
• A Robust Bayesian Meta-Analysis for Estimating the Hubble Constant via Time Delay Cosmography
• Multimodal Information Gain in Bayesian Design of Experiments
• Stochastic Approximation Hamiltonian Monte Carlo