Hyperbolic recurrent neural network as the first type of non-Euclidean neural quantum state ansatz

Abstract

In this work, we introduce the first type of non-Euclidean neural quantum state (NQS) ansatz, in the form of the hyperbolic GRU (a variant of recurrent neural networks (RNNs)), to be used in the Variational Monte Carlo method of approximating the ground state energy for quantum many-body systems. In particular, we examine the performances of NQS ansatzes constructed from both conventional or Euclidean RNN/GRU and from hyperbolic GRU in the prototypical settings of the one- and two-dimensional transverse field Ising models (TFIM) and the one-dimensional Heisenberg $J_1{J}_2$ and $J_1{J}_2{J}_3$ systems. By virtue of the fact that, for all of the experiments performed in this work, hyperbolic GRU can yield performances comparable to or better than Euclidean RNNs, which have been extensively studied in these settings in the literature, our work is a proof-of-concept for the viability of hyperbolic GRU as the first type of non-Euclidean NQS ansatz for quantum many-body systems. Furthermore, in settings where the Hamiltonian displays a clear hierarchical interaction structure, such as the 1D Heisenberg $J_1{J}_2$ & $J_1{J}_2{J}_3$ systems with the 1st, 2nd and even 3rd nearest neighbor interactions, our results show that hyperbolic GRU definitively outperforms its Euclidean version in almost all instances. The fact that these results are reminiscent of the established ones from natural language processing where hyperbolic GRU almost always outperforms Euclidean RNNs when the training data exhibit a tree-like or hierarchical structure leads us to hypothesize that hyperbolic GRU NQS ansatz would likely outperform Euclidean RNN/GRU NQS ansatz in quantum spin systems that involve different degrees of nearest neighbor interactions. Finally, with this work, we hope to initiate future studies of other types of non-Euclidean NQS beyond hyperbolic GRU.

v2: additional experiments and results included, typo corrected. v3: inference experiments redone, all results updated, conclusions remain qualitatively the same. v4: minor updates of some figures, more descriptions added, matches the published version on EPJP

References in corpus (11)

• Hyperbolic Geometry of Complex Networks
• Restricted-Boltzmann-Machine Learning for Solving Strongly Correlated Quantum Systems
• Solving the Bose-Hubbard model with machine learning
• Curvature and temperature of complex networks
• Machine learning technique to find quantum many-body ground states of bosons on a lattice
• Transformer variational wave functions for frustrated quantum spin systems
• High-accuracy variational Monte Carlo for frustrated magnets with deep neural networks
• Matrix Model simulations using Quantum Computing, Deep Learning, and Lattice Monte Carlo
• Variational Monte Carlo with Large Patched Transformers
• Transformer Wave Function for two dimensional frustrated magnets: emergence of a Spin-Liquid Phase in the Shastry-Sutherland Model
• Transformer neural networks and quantum simulators: a hybrid approach for simulating strongly correlated systems