Addressing the Infinite Variance Problem in Fermionic Monte Carlo Simulations: Retrospective Error Remediation and the Exact Bridge Link Method

Abstract

We revisit the infinite variance problem in fermionic Monte Carlo simulations, which is widely encountered in areas ranging from condensed matter to nuclear and high-energy physics. The different algorithms, which we broadly refer to as determinantal quantum Monte Carlo (DQMC), are applied in many situations and differ in details, but they share a foundation in field theory, and often involve fermion determinants whose symmetry properties make the algorithm sign-problem-free. We show that the infinite variance problem arises as the observables computed in DQMC tend to form heavy-tailed distributions. To remedy this issue retrospectively, we introduce a tail-aware error estimation method to correct the otherwise unreliable estimates of confidence intervals. Furthermore, we demonstrate how to perform DQMC calculations that eliminate the infinite variance problem for a broad class of observables. Our approach is an exact bridge link method, which involves a simple and efficient modification to the standard DQMC algorithm. The method introduces no systematic bias and is straightforward to implement with minimal computational overhead. Our results establish a practical and robust solution to the infinite variance problem, with broad implications for improving the reliability of a variety of fundamental fermion simulations.

11 pages + appendix, 8 figures

References in corpus (38)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Full nonperturbative QCD simulations with 2+1 flavors of improved staggered quarks
• Charge $4e$ superconductivity from pair density wave order in certain high temperature superconductors
• A sufficient condition for the absence of the sign problem in the fermionic quantum Monte-Carlo algorithm
• Superconductivity and non-Fermi liquid behavior near a nematic quantum critical point
• Universal quantum criticality in the metal-insulator transition of two-dimensional interacting Dirac electrons
• Observation of canted antiferromagnetism with ultracold fermions in an optical lattice
• Stable liquid Hydrogen at high pressure by a novel ab-initio molecular dynamics
• Fermions in 2D Optical Lattices: Temperature and Entropy Scales for Observing Antiferromagnetism and Superfluidity
• Majorana-time-reversal symmetries: a fundamental principle for sign-problem-free quantum Monte Carlo simulations
• Fermion-induced quantum critical points
• Majorana Positivity and the Fermion sign problem of Quantum Monte Carlo Simulations
• Sign-Problem-Free Fermionic Quantum Monte Carlo: Developments and Applications
• Benchmark study of the two-dimensional Hubbard model with auxiliary-field quantum Monte Carlo method
• Exact Numerical Results on the Ground State of Strongly Interacting Fermi Gases in Two Dimensions
• Symmetry in Auxiliary-Field Quantum Monte Carlo Calculations
• Phase transitions in a three dimensional $U(1)\times U(1)$ lattice London superconductor: Metallic superfluid and charge-4e superconducting states
• Split orthogonal group: A guiding principle for sign-problem-free fermionic simulations
• Competing orders in the 2D half-filled SU(2N) Hubbard model through the pinning field quantum Monte-Carlo simulations
• The Gross-Neveu-Yukawa Archipelago
• Infinite Variance in Fermion Quantum Monte Carlo Calculations
• Unbiasing time-dependent Variational Monte Carlo by projected quantum evolution
• Charge-4e and charge-6e flux quantization and higher charge superconductivity in kagome superconductor ring devices
• Charge-$4e$ superconductivity from nematic superconductors in 2D and 3D
• Observation of Emergent Spacetime Supersymmetry at Superconducting Quantum Criticality
• Heavy-tailed random error in quantum Monte Carlo
• A neutral-atom Hubbard quantum simulator in the cryogenic regime
• Competing nodal d-wave superconductivity and antiferromagnetism
• Rashba spin-orbit coupling, strong interactions, and the BCS-BEC crossover in the ground state of the two-dimensional Fermi Gas
• Symmetry constraints on superconductivity in twisted bilayer graphene: Fractional vortices, $4e$ condensates or non-unitary pairing
• Extended Metal-Insulator Crossover with Strong Antiferromagnetic Spin Correlation in Half-Filled 3D Hubbard Model
• Mitigating the fermion sign problem by automatic differentiation
• Emus live on the Gross-Neveu-Yukawa archipelago
• Semigroup approach to the sign problem in quantum Monte Carlo simulations
• Autoregressive neural Slater-Jastrow ansatz for variational Monte Carlo simulation
• On the Infinite Variance Problem in Fermion Models
• Automatic Order Detection and Restoration Through Systematically Improvable Variational Wave Functions
• Infinite Variance in Monte Carlo Sampling of Lattice Field Theories