Multicanonical MCMC for Sampling Rare Events
arXiv:1305.3039 · doi:10.1007/s10463-014-0460-2
Abstract
Multicanonical MCMC (Multicanonical Markov Chain Monte Carlo; Multicanonical Monte Carlo) is discussed as a method of rare event sampling. Starting from a review of the generic framework of importance sampling, multicanonical MCMC is introduced, followed by applications in random matrices, random graphs, and chaotic dynamical systems. Replica exchange MCMC (also known as parallel tempering or Metropolis-coupled MCMC) is also explained as an alternative to multicanonical MCMC. In the last section, multicanonical MCMC is applied to data surrogation; a successful implementation in surrogating time series is shown. In the appendices, calculation of averages and normalizing constant in an exponential family, phase coexistence, simulated tempering, parallelization, and multivariate extensions are discussed.
arXiv commentPresented at BayesComp2012;in the journal format (NOT a4 size); Major revised from the previous Arxiv version. Fig.3 and Fig.13(Fig.12 old) is revised and Fig.6 is added. Sec.2.2.5 is added. Results in Sec.4.2.3 are substituted, including figures. Many other important changes. A typo in the publication version is corrected; in the footnote 15, Q_{opt} should be replaced by Q_*. The final publication is available at springerlink.com http://link.springer.com/article/10.1007%2Fs10463-014-0460-2
References in corpus (52)
- MCMC using Hamiltonian dynamics
- An efficient, multiple range random walk algorithm to calculate the density of states
- Exchange Monte Carlo Method and Application to Spin Glass Simulations
- Level-Spacing Distributions and the Airy Kernel
- Simulated Tempering: A New Monte Carlo Scheme
- Multicanonical Ensemble: A New Approach to Simulate First-order Phase Transitions
- Surrogate time series
- Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
- On Orthogonal and Symplectic Matrix Ensembles
- Entangled networks, synchronization, and optimal network topology
- A New Approach to Spin Glass Simulations
- Extended Ensemble Monte Carlo
- Fast Algorithm to Calculate Density of States
- On the Wang-Landau Method for Off-Lattice Simulations in the "Uniform" Ensemble
- Extreme Value Statistics of Eigenvalues of Gaussian Random Matrices
- Transition Matrix Monte Carlo Method
- Constrained randomization of time series data
- Density of States Monte Carlo Method for Simulation of Fluids
- Wang-Landau algorithm for continuous models and joint density of states
- Large Deviations of the Maximum Eigenvalue for Wishart and Gaussian Random Matrices
- Wang-Landau Algorithm: a Theoretical Analysis of the Saturation of the Error
- Avoiding Boundary Effects in Wang-Landau Sampling
- Multicanonical Chain Growth Algorithm
- Probing rare physical trajectories with Lyapunov weighted dynamics
- A generic, hierarchical framework for massively parallel Wang-Landau sampling
- Sampling along reaction coordinates with the Wang-Landau method
- Sampling rare events: statistics of local sequence alignments
- Cosmology From Random Multifield Potentials
- Multi-Self-Overlap Ensemble for protein folding: ground state search and thermodynamics
- Broad Histogram Monte Carlo
- Simulation of Lattice Polymers with Multi-Self-Overlap Ensemble
- Convergence and Refinement of the Wang-Landau Algorithm
- Optimal Modification Factor and Convergence of the Wang-Landau Algorithm
- Optimized Wang-Landau sampling of lattice polymers: Ground state search and folding thermodynamics of HP model proteins
- Simulation via Direct Computation of Partition Functions
- Large deviations of Lyapunov exponents
- Number of Magic Squares From Parallel Tempering Monte Carlo
- Probing the tails of the ground state energy distribution for the directed polymer in a random medium of dimension via a Monte-Carlo procedure in the disorder
- Multicanonical sampling of rare events in random matrices
- Probing tails of energy distributions using importance-sampling in the disorder with a guiding function
- Identifying rare chaotic and regular trajectories in dynamical systems with Lyapunov weighted path sampling
- Computation of the Kolmogorov-Sinai entropy using statistitical mechanics: Application of an exchange Monte Carlo method
- Distribution of Lee-Yang zeros and Griffiths singularities in the model of spin glasses
- Probability of graphs with large spectral gap by multicanonical Monte Carlo
- Testing Error Correcting Codes by Multicanonical Sampling of Rare Events
- Counting Solutions for the N-queens and Latin Square Problems by Efficient Monte Carlo Simulations
- A Monte Carlo Algorithm for Sampling Rare Events: Application to a Search for the Griffiths Singularity
- Exploration of Order in Chaos with Replica Exchange Monte Carlo
- Multicanonical Sampling of Rare Trajectories in Chaotic Dynamical Systems
- Random matrix ensembles: Wang-Landau algorithm for spectral densities
- Split Sampling: Expectations, Normalisation and Rare Events
- Multi-dimensional Density of States by Multicanonical Monte Carlo
Cited by in corpus (13)
- Quantum enhancements for deep reinforcement learning in large spaces
- Emergence of cooperative bistability and robustness of gene regulatory networks
- A surrogate accelerated multicanonical Monte Carlo method for uncertainty quantification
- Rare-Event Sampling Analysis Uncovers the Fitness Landscape of the Genetic Code
- Evolution enhances mutational robustness and suppresses the emergence of a new phenotype: A new computational approach for studying evolution
- A subset multicanonical Monte Carlo method for simulating rare failure events
- Moving the epidemic tipping point through topologically targeted social distancing
- Importance Sampling of Rare Events in Chaotic Systems
- Taming chaos to sample rare events: the effect of weak chaos
- Phenotype selection due to mutational robustness
- Patchwork Sampling of Stochastic Differential Equations
- Large deviation and anomalous fluctuations scaling in degree assortativity on configuration networks
- Monte Carlo sampling in diffusive dynamical systems