Effects of setting the temperatures in the parallel tempering Monte Carlo algorithm

Abstract

Parallel tempering Monte Carlo has proven to be an efficient method in optimization and sampling applications. Having an optimized temperature set enhances the efficiency of the algorithm through more-frequent replica visits to the temperature limits. The approaches for finding an optimal temperature set can be divided into two main categories. The methods of the first category distribute the replicas such that the swapping ratio between neighbouring replicas is constant and independent of the temperature values. The second-category techniques including the feedback-optimized method, on the other hand, aim for a temperature distribution that has higher density at simulation bottlenecks, resulting in temperature-dependent replica-exchange probabilities. In this paper, we compare the performance of various temperature setting methods on both sparse and fully-connected spin-glass problems as well as fully-connected Wishart problems that have planted solutions. These include two classes of problems that have either continuous or discontinuous phase transitions in the order parameter. Our results demonstrate that there is no performance advantage for the methods that promote nonuniform swapping probabilities on spin-glass problems where the order parameter has a smooth transition between phases at the critical temperature. However, on Wishart problems that have a first-order phase transition at low temperatures, the feedback-optimized method exhibits a time-to-solution speedup of at least a factor of two over the other approaches.

arXiv comment10 pages, 27 figures, 1 table

References in corpus (17)

• Exchange Monte Carlo Method and Application to Spin Glass Simulations
• Parallel Tempering: Theory, Applications, and New Perspectives
• Defining and detecting quantum speedup
• Physics-Inspired Optimization for Quadratic Unconstrained Problems Using a Digital Annealer
• Feedback-optimized parallel tempering Monte Carlo
• Optimizing the ensemble for equilibration in broad-histogram Monte Carlo simulations
• Strengths and weaknesses of weak-strong cluster problems: A detailed overview of state-of-the-art classical heuristics vs quantum approaches
• The incomplete beta function law for parallel tempering sampling of classical canonical systems
• Domain-Wall Free-Energy of Spin Glass Models:Numerical Method and Boundary Conditions
• Comparing Monte Carlo methods for finding ground states of Ising spin glasses: population annealing, simulated annealing and parallel tempering
• Finding Low-Temperature States with Parallel Tempering, Simulated Annealing and Simple Monte Carlo
• Strengths and Weaknesses of Parallel Tempering
• Exact Ground States of Large Two-Dimensional Planar Ising Spin Glasses
• Monte Carlo Methods for Rough Free Energy Landscapes: Population Annealing and Parallel Tempering
• Robust Parameter Selection for Parallel Tempering
• First-order phase transitions: A study through the parallel tempering method
• borealis - A generalized global update algorithm for Boolean optimization problems

Cited by in corpus (12)

• Discrete Polynomial Optimization with Coherent Networks of Condensates and Complex Coupling Switching
• Directly observing replica symmetry breaking in a vector quantum-optical spin glass
• Fast Bayesian Deconvolution using Simple Reversible Jump Moves
• Replica exchange nested sampling
• Secondary-Structure Phase Formation for Semifelxible Polymers by Bifurcation in Hyperphase Space
• Automatic Structural Search of Tensor Network States including Entanglement Renormalization
• Parallel Tempering-Inspired Distributed Binary Optimization with In-Memory Computing
• Improving accuracy of tree-tensor network approach by optimization of network structure
• Adsorbate phase transitions on nanoclusters from nested sampling
• Role of positional disorder in fully textured ensembles of Ising-like dipoles
• Quantum-inspired search method for low-energy states of classical Ising Hamiltonians
• Optimizing Temperature Distributions for Training Neural Quantum States using Parallel Tempering