Automatic Differentiable Monte Carlo: Theory and Application
arXiv:1911.09117 · doi:10.1103/PhysRevResearch.5.033041
Abstract
Differentiable programming has emerged as a key programming paradigm empowering rapid developments of deep learning while its applications to important computational methods such as Monte Carlo remain largely unexplored. Here we present the general theory enabling infinite-order automatic differentiation on expectations computed by Monte Carlo with unnormalized probability distributions, which we call "automatic differentiable Monte Carlo" (ADMC). By implementing ADMC algorithms on computational graphs, one can also leverage state-of-the-art machine learning frameworks and techniques to traditional Monte Carlo applications in statistics and physics. We illustrate the versatility of ADMC by showing some applications: fast search of phase transitions and accurately finding ground states of interacting many-body models in two dimensions. ADMC paves a promising way to innovate Monte Carlo in various aspects to achieve higher accuracy and efficiency, e.g. easing or solving the sign problem of quantum many-body models through ADMC.
arXiv comment11.5 pages + supplemental materials, 4 figures
References in corpus (54)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- The density-matrix renormalization group in the age of matrix product states
- Solving the Quantum Many-Body Problem with Artificial Neural Networks
- Continuous-time Monte Carlo methods for quantum impurity models
- Computational complexity and fundamental limitations to fermionic quantum Monte Carlo simulations
- Deep neural network solution of the electronic Schrödinger equation
- Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
- Finite-Size Scaling of the Ground State Parameters of the Two-Dimensional Heisenberg Model
- Optimizing Neural Networks with Kronecker-factored Approximate Curvature
- Machine learning quantum phases of matter beyond the fermion sign problem
- Generalized Lanczos Algorithm for Variational Quantum Monte Carlo
- Restricted-Boltzmann-Machine Learning for Solving Strongly Correlated Quantum Systems
- A Review of automatic differentiation and its efficient implementation
- New insights and perspectives on the natural gradient method
- Machine Learning Topological States
- Green Function Monte Carlo with Stochastic Reconfiguration
- Deep autoregressive models for the efficient variational simulation of many-body quantum systems
- Symmetries and many-body excited states with neural-network quantum states
- Differentiable Programming Tensor Networks
- A sufficient condition for the absence of the sign problem in the fermionic quantum Monte-Carlo algorithm
- Approximating quantum many-body wave-functions using artificial neural networks
- Neural-Network Quantum States, String-Bond States, and Chiral Topological States
- Algorithms for finite Projected Entangled Pair States
- Solving fermion sign problem in quantum Monte Carlo by Majorana representation
- Sign-problem-free quantum Monte Carlo of the onset of antiferromagnetism in metals
- Gradient Estimation Using Stochastic Computation Graphs
- Constructing exact representations of quantum many-body systems with deep neural networks
- Solving the Bose-Hubbard model with machine learning
- Majorana-time-reversal symmetries: a fundamental principle for sign-problem-free quantum Monte Carlo simulations
- Majorana Positivity and the Fermion sign problem of Quantum Monte Carlo Simulations
- Revisiting Natural Gradient for Deep Networks
- Algorithmic differentiation and the calculation of forces by quantum Monte Carlo
- Sign-Problem-Free Fermionic Quantum Monte Carlo: Developments and Applications
- Solving frustrated quantum many-particle models with convolutional neural networks
- Restricted Boltzmann Machines for Quantum States with Nonabelian or Anyonic Symmetries
- Ground-State Properties of Quantum Many-Body Systems: Entangled-Plaquette States and Variational Monte Carlo
- Monte Carlo simulation with Tensor Network States
- Chiral Topological Phases from Artificial Neural Networks
- Easing the Monte Carlo sign problem
- Solution to sign problems in half-filled spin-polarized electronic systems
- Split orthogonal group: A guiding principle for sign-problem-free fermionic simulations
- Geometry of learning neural quantum states
- Deep Learning-Enhanced Variational Monte Carlo Method for Quantum Many-Body Physics
- Wavefunction positivization via automatic differentiation
- Variational optimization in the AI era: Computational Graph States and Supervised Wave-function Optimization
- Mitigating the Sign Problem Through Basis Rotations
- Alleviating the Sign Problem in Quantum Monte Carlo Simulations of Spin-Orbit-Coupled Multi-Orbital Hubbard Models
- Ground state phase diagram of the one-dimensional Bose-Hubbard model from restricted Boltzmann machines
- Mitigating the fermion sign problem by automatic differentiation
- Pathological spectra of the Fisher information metric and its variants in deep neural networks
- Use and implementation of autodifferentiation in tensor network methods with complex scalars
- Automatic Differentiation for Complex Valued SVD
- Multi-Layer Restricted Boltzmann Machine Representation of 1D Quantum Many-Body Wave Functions
Cited by in corpus (12)
- Differentiable Quantum Architecture Search
- Variational Neural Annealing
- Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
- Automatic Differentiable Numerical Renormalization Group
- Variational optimization of the amplitude of neural-network quantum many-body ground states
- Stabilizer ground states for simulating quantum many-body physics: theory, algorithms, and applications
- Towards quantum gravity with neural networks: Solving the quantum Hamilton constraint of U(1) BF theory
- Machine learning one-dimensional spinless trapped fermionic systems with neural-network quantum states
- A differentiable programming framework for spin models
- Effective temperature in approximate quantum many-body states
- Lattice Protein Folding with Variational Annealing
- Generalized Lanczos method for systematic optimization of neural-network quantum states