Feedback-optimized parallel tempering Monte Carlo

Abstract

We introduce an algorithm to systematically improve the efficiency of parallel tempering Monte Carlo simulations by optimizing the simulated temperature set. Our approach is closely related to a recently introduced adaptive algorithm that optimizes the simulated statistical ensemble in generalized broad-histogram Monte Carlo simulations. Conventionally, a temperature set is chosen in such a way that the acceptance rates for replica swaps between adjacent temperatures are independent of the temperature and large enough to ensure frequent swaps. In this paper, we show that by choosing the temperatures with a modified version of the optimized ensemble feedback method we can minimize the round-trip times between the lowest and highest temperatures which effectively increases the efficiency of the parallel tempering algorithm. In particular, the density of temperatures in the optimized temperature set increases at the "bottlenecks'' of the simulation, such as phase transitions. In turn, the acceptance rates are now temperature dependent in the optimized temperature ensemble. We illustrate the feedback-optimized parallel tempering algorithm by studying the two-dimensional Ising ferromagnet and the two-dimensional fully-frustrated Ising model, and briefly discuss possible feedback schemes for systems that require configurational averages, such as spin glasses.

12 pages, 14 figures

References in corpus (13)

• An efficient, multiple range random walk algorithm to calculate the density of states
• Exchange Monte Carlo Method and Application to Spin Glass Simulations
• Simulated Tempering: A New Monte Carlo Scheme
• Multicanonical Ensemble: A New Approach to Simulate First-order Phase Transitions
• Parallel Tempering: Theory, Applications, and New Perspectives
• Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
• Transition Matrix Monte Carlo Method
• Optimizing the ensemble for equilibration in broad-histogram Monte Carlo simulations
• Performance Limitations of Flat Histogram Methods and Optimality of Wang-Landau Sampling
• On the Phase Structure of the 3D Edwards Anderson Spin Glass
• The incomplete beta function law for parallel tempering sampling of classical canonical systems
• Dynamics of the Wang-Landau algorithm and complexity of rare events for the three-dimensional bimodal Ising spin glass
• Analytical study of tunneling times in flat histogram Monte Carlo

Cited by in corpus (123)

• Adiabatic Quantum Computing
• The ALPS project release 1.3: open source software for strongly correlated systems
• The ALPS project release 2.0: Open source software for strongly correlated systems
• Physics-Inspired Optimization for Quadratic Unconstrained Problems Using a Digital Annealer
• Enhanced sampling methods for molecular dynamics simulations
• Dynamic temperature selection for parallel-tempering in Markov chain Monte Carlo simulations
• Enhanced Sampling in the Well-Tempered Ensemble
• Symmetries and many-body excited states with neural-network quantum states
• Replica exchange and expanded ensemble simulations as Gibbs sampling: Simple improvements for enhanced mixing
• Quantum Machine Learning in High Energy Physics
• Generalized Ensemble and Tempering Simulations: A Unified View
• Seeking Quantum Speedup Through Spin Glasses: The Good, the Bad, and the Ugly
• Complete-Graph Tensor Network States: A New Fermionic Wave Function Ansatz for Molecules
• Make life simple: unleash the full power of the parallel tempering algorithm
• Using the average spectrum method to extract dynamics from quantum Monte Carlo simulations
• Scalable replica-exchange framework for Wang-Landau sampling
• Auxiliary master equation approach within matrix product states: Spectral properties of the nonequilibrium Anderson impurity model
• Population annealing: Theory and application in spin glasses
• Non-Reversible Parallel Tempering: a Scalable Highly Parallel MCMC Scheme
• Performance potential for simulating spin models on GPU
• Phase diagram of the Ising square lattice with competing interactions
• Quantum critical properties of a metallic spin density wave transition
• B-T phase diagram of Pd/Fe/Ir(111) computed with parallel tempering Monte Carlo
• Location of the Potts-critical end point in the frustrated Ising model on the square lattice
• Three-dimensional color code thresholds via statistical-mechanical mapping
• Analysis of the phase transition for the Ising model on the frustrated square lattice
• An Infinite Swapping Approach to the Rare-Event Sampling Problem
• 3-Regular 3-XORSAT Planted Solutions Benchmark of Classical and Quantum Heuristic Optimizers
• Optimized auxiliary representation of a non-Markovian environment by a Lindblad equation
• Readiness of Quantum Optimization Machines for Industrial Applications
• Strengths and Weaknesses of Parallel Tempering
• Error Thresholds for Abelian Quantum Double Models: Increasing the bit-flip Stability of Topological Quantum Memory
• Propagation and Ghosts in the Classical Kagome Antiferromagnet
• From Near to Eternity: Spin-glass planting, tiling puzzles, and constraint satisfaction problems
• On Dynamics and Optimal Number of Replicas in Parallel Tempering Simulations
• Topological critical slowing down: variations on a toy model
• Heavy tails in the distribution of time-to-solution for classical and quantum annealing
• Efficient measurement of point-to-set correlations and overlap fluctuations in glass-forming liquids
• Superconductivity and Nematic Fluctuations in a model of FeSe monolayers: A Determinant Quantum Monte Carlo Study
• Interplay between folding and assembly of fibril-forming polypeptides
• Riemann metric approach to optimal sampling of multidimensional free-energy landscapes
• Towards Quantum Belief Propagation for LDPC Decoding in Wireless Networks
• Phase structure and phase transitions in a three dimensional SU(2) superconductor
• Dynamic Variational Study of Chaos: Spin Glasses in Three Dimensions
• Optimal Thresholds for Fracton Codes and Random Spin Models with Subsystem Symmetry
• Phase transitions in spin-orbital models with spin-space anisotropies for iron-pnictides: A study through Monte Carlo simulations
• Scaling Advantage in Approximate Optimization with Quantum Annealing
• Physics-Inspired Heuristics for Soft MIMO Detection in 5G New Radio and Beyond
• Spirals and skyrmions in antiferromagnetic triangular lattices
• Simulated Quantum Annealing with Two All-to-All Connectivity Schemes
• Optimal error correction in topological subsystem codes
• Parallel Tempering Simulation of the three-dimensional Edwards-Anderson Model with Compact Asynchronous Multispin Coding on GPU
• Solving frustrated Ising models using tensor networks
• Correlations between the dynamics of parallel tempering and the free-energy landscape in spin glasses
• Numerical and analytical bounds on threshold error rates for hypergraph-product codes
• Equation Planting: A Tool for Benchmarking Ising Machines
• Monte Carlo Methods for Rough Free Energy Landscapes: Population Annealing and Parallel Tempering
• Effects of setting the temperatures in the parallel tempering Monte Carlo algorithm
• Comparing parallel and simulated tempering enhanced sampling algorithms at phase transition regimes
• Optimized GPU simulation of continuous-spin glass models
• Computational hardness of spin-glass problems with tile-planted solutions
• Rare-Event Sampling: Occupation-Based Performance Measures for Parallel Tempering and Infinite Swapping Monte Carlo Methods
• Non-Coplanar Magnetic Orders in Classical Square-Kagome Antiferromagnets
• Machine-Learned Phase Diagrams of Generalized Kitaev Honeycomb Magnets
• Critical behavior of the random-anisotropy model in the strong-anisotropy limit
• Euclidean Dynamical Triangulation revisited: is the phase transition really 1st order? (extended version)
• Adaptive Multi-GPU Exchange Monte Carlo for the 3D Random Field Ising Model
• Noncoplanar orders and quantum disordered states in maple-leaf (anti)ferromagnets
• Structure and stability of helices in square-well homopolymers
• Estimating the Density of States of Frustrated Spin Systems
• Speeding up parallel tempering simulations
• First-order phase transitions: A study through the parallel tempering method
• Viewing Vanilla Quantum Annealing Through Spin Glasses
• Optimized Broad-Histogram Ensembles for the Simulation of Quantum Systems
• Intra-Globular Structures in Multiblock Copolymer Chains from a Monte Carlo Simulation
• Comparing different protocols of temperature selection in the parallel tempering method
• Exchange interactions and spin dynamics in the layered honeycomb ferromagnet CrI${}_3$
• Optimized broad-histogram simulations for strong first-order phase transitions: Droplet transitions in the large-Q Potts model
• On Performance Measures for Infinite Swapping Monte Carlo Methods
• Mesoscopic real space structures in aging spin-glasses: the Edwards-Anderson model
• Order by disorder and phase transitions in a highly frustrated spin model on the triangular lattice
• Quantum disordered ground state for hard-core bosons on the frustrated square lattice
• Spin Glass in the Bond-Diluted J1-J2 Ising Model on the Square Lattice
• Phase diagram of dipolar-coupled XY moments on disordered square lattices
• A comparative study of selected parallel tempering methods
• Chiral spin liquids with crystalline ${\mathbb{Z}}_2$ gauge order in a three-dimensional Kitaev model
• Spin-liquid phase and order-by-disorder of classical Heisenberg spins on the swedenborgite lattice
• Towards an optimal flow: Density-of-states-informed replica-exchange simulations
• The antiferromagnetic Ising model on the swedenborgite lattice
• Feeding the multitude: A polynomial-time algorithm to improve sampling
• Pushing the Boundary of Quantum Advantage in Hard Combinatorial Optimization with Probabilistic Computers
• The competition between surface adsorption and folding of fibril-forming polypeptides
• Stability of topologically-protected quantum computing proposals as seen through spin glasses
• Approximate ground states of the random-field Potts model from graph cuts
• Optimized Folding Simulations of Protein A
• Optimal schedules for annealing algorithms
• The classical $J_1$-$J_2$ Heisenberg model on the Kagome lattice
• Two-dimensional Parallel Tempering for Constrained Optimization
• Designed-walk replica-exchange method for simulations of complex systems
• Superfluid Spin Transistor
• Tensor Network States with Three-Site Correlators
• Liouville Space Neural Network Representation of Density Matrices
• Topological floating phase in a spatially anisotropic frustrated Ising model
• Kinetics of first-order phase transitions from microcanonical thermostatistics
• Monte Carlo study of the two-dimensional site-diluted dipolar Ising model
• Nonflat Histogram Techniques for Spin Glasses
• Extension of the constant exchange probability method to multi-dimensional replica exchange Monte Carlo applied to the tri-critical spin-1 Blume-Capel model
• Time evolution of photon-pulse propagation in scattering and absorbing media: The dynamic radiative transfer system
• Massively parallel simulations for disordered systems
• Spin Hall effect of vorticity
• Hybrid Symmetry Breaking in Classical Spin Models With Subsystem Symmetries
• Quantum-Inspired Tempering for Ground State Approximation using Artificial Neural Networks
• Critical behavior and out-of-equilibrium dynamics of a two-dimensional Ising model with dynamic couplings
• Quantum disordered ground state for the frustrated square lattice
• Closing the Evidence Gap: reddemcee, a Fast Adaptive Parallel Tempering Sampler
• Global hierarchy vs. local structure: spurious self-feedback in scale-free networks
• Quantum Annealing Algorithms for Estimating Ising Partition Functions
• Field-induced Multi-$\vec{\mathbf{Q}}$ States in a Pyrochlore Heisenberg Magnet
• Complex path simulations of geometrically frustrated ladders
• Error Resilience of Fracton Codes and Near Saturation of Code-Capacity Threshold in Three Dimensions
• Thermal and quantum fluctuations in extended Kitaev-Yao-Lee spin-orbital model
• Frustration-induced degenerate spin state with up-up-down-down ordering in corner-connected Heisenberg square-plaquettes
• Optimizing Temperature Distributions for Training Neural Quantum States using Parallel Tempering