Automatic Differentiation for Second Renormalization of Tensor Networks

Abstract

Tensor renormalization group (TRG) constitutes an important methodology for accurate simulations of strongly correlated lattice models. Facilitated by the automatic differentiation technique widely used in deep learning, we propose a uniform framework of differentiable TRG ($\partial$TRG) that can be applied to improve various TRG methods, in an automatic fashion. Essentially, $\partial$TRG systematically extends the concept of second renormalization [PRL 103, 160601 (2009)] where the tensor environment is computed recursively in the backward iteration, in the sense that given the forward process of TRG, $\partial$TRG automatically finds the gradient through backpropagation, with which one can deeply "train" the tensor networks. We benchmark $\partial$TRG in solving the square-lattice Ising model, and demonstrate its power by simulating one- and two-dimensional quantum systems at finite temperature. The deep optimization as well as GPU acceleration renders $\partial$TRG manybody simulations with high efficiency and accuracy.

13 pages, 9 figures

References in corpus (40)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Machine learning phases of matter
• Entanglement renormalization
• Tensor-Entanglement-Filtering Renormalization Approach and Symmetry Protected Topological Order
• Learning phase transitions by confusion
• The ALPS project release 2.0: Open source software for strongly correlated systems
• Tensor renormalization group approach to 2D classical lattice models
• Accurate determination of tensor network state of quantum lattice models in two dimensions
• Coarse-graining renormalization by higher-order singular value decomposition
• Tensor Network Renormalization
• Neel order in square and triangular lattice Heisenberg models
• Algorithms for entanglement renormalization
• Unsupervised Generative Modeling Using Matrix Product States
• Second Renormalization of Tensor-Network States
• Signatures of Dirac cones in a DMRG study of the Kagome Heisenberg model
• Differentiable Programming Tensor Networks
• Mutual Information, Neural Networks and the Renormalization Group
• Renormalization of tensor-network states
• Loop optimization for tensor network renormalization
• Neural Network Renormalization Group
• Tensor network renormalization yields the multi-scale entanglement renormalization ansatz
• Real Space Renormalization in Statistical Mechanics
• Projected Entangled Pair States at Finite Temperature: Imaginary Time Evolution with Ancillas
• Linearized Tensor Renormalization Group Algorithm for Thermodynamics of Quantum Lattice Models
• Exponential Thermal Tensor Network Approach for Quantum Lattice Models
• Kosterlitz-Thouless Melting of Magnetic Order in the Triangular Quantum Ising Material TmMgGaO${}_4$
• Finite correlation length scaling with infinite projected entangled-pair states
• Variational Approach to Projected Entangled Pair States at Finite Temperature
• A tensor network annealing algorithm for two-dimensional thermal states
• Renormalization group flows of Hamiltonians using tensor networks
• Two-temperature scales in the triangular-lattice Heisenberg antiferromagnet
• Finite correlation length scaling with infinite projected entangled pair states at finite temperature
• Matrix Product Operators for Sequence to Sequence Learning
• Series-Expansion Thermal Tensor Network Approach for Quantum Lattice Models
• Tensor network algorithm by coarse-graining tensor renormalization on finite periodic lattices
• Thermal Tensor Renormalization Group Simulations of Square-Lattice Quantum Spin Models
• Universal entropy of conformal critical theories on a Klein bottle
• Bilayer Linearized Tensor Renormalization Group Approach for Thermal Tensor Networks
• Conformal Thermal Tensor Network and Universal Entropy on Topological Manifolds
• Examples of renormalization group transformations for image sets

Cited by in corpus (26)

• Tensor lattice field theory with applications to the renormalization group and quantum computing
• First-order transition between the plaquette valence bond solid and antiferromagnetic phases of the Shastry-Sutherland model
• A scheme for automatic differentiation of complex loss functions
• Automatically Differentiable Quantum Circuit for Many-qubit State Preparation
• Continuous matrix product operator approach to finite temperature quantum states
• Magnetization of the spin-1/2 Heisenberg antiferromagnet on the triangular lattice
• GPU-Acceleration of Tensor Renormalization with PyTorch using CUDA
• Variational optimization of tensor-network states with the honeycomb-lattice corner transfer matrix
• Mitigating the fermion sign problem by automatic differentiation
• Learning Effective Spin Hamiltonian of Quantum Magnet
• Global optimization of tensor renormalization group using the corner transfer matrix
• Triad second renormalization group
• The Green's function Monte Carlo combined with projected entangled pair state approach to the frustrated $J_1$-$J_2$ Heisenberg model
• Calculation of critical exponents on fractal lattice Ising model by higher-order tensor renormalization group method
• Measurements of magnetization on the Sierpiński carpet
• Exploring explicit coarse-grained structure in artificial neural networks
• Theory of magnetism for rare-earth magnets on the Shastry-Sutherland lattice with non-Kramers ions
• Long-range spin-orbital order in the spin-orbital SU(2)$\times$SU(2)$\times$U(1) model
• Efficient Simulation of Quantum Many-body Thermodynamics by Tailoring Zero-temperature Tensor Network
• Tensor Network Efficiently Representing Schmidt Decomposition of Quantum Many-Body States
• Single-layer framework of variational tensor network states
• Forward-mode automatic differentiation for the tensor renormalization group and its relation to the impurity method
• A hybrid method integrating Green's function Monte Carlo and projected entangled pair states
• Variational boundary based tensor network renormalization group
• Accurate simulation and thermal tuning by temperature-adaptive boundary interactions on quantum many-body systems
• Preparation of Many-body Ground States by Time Evolution with Variational Microscopic Magnetic Fields and Incomplete Interactions