Investigation of the $J_1$-$J_2$ Heisenberg model on the triangular lattice: A study with projected entangled-pair states

Abstract

The nature of the quantum spin liquid (QSL) phase in the frustrated $J_1$-$J_2$ Heisenberg model on the triangular lattice remains an open and actively debated problem. In this work, we employ the infinite projected entangled-pair state (PEPS) to systematically investigate the model under different symmetry constraints. Our simulations reveal a direct transition from the $120^{\circ }$ Néel state to a putative QSL at $J_2/J_1\approx 0.08$, signaled by the collapse of magnetic order. We further show that, through either an appropriate unitary rotation or spontaneous spin long-range order, the stripe antiferromagnetic phase can also be accurately captured within the infinite PEPS framework. A central focus of our study is the role played by the PEPS symmetry in approximating the QSL ground-state sandwiched between the two magnetic phases. We first found that a fully-symmetric topological ${\mathbb{Z}}_2$ Resonating Valence Bond state, which can be written as a simple PEPS with bond dimension $D=3$, exhibits a reasonably good variational energy. Motivated by this finding, we have further constructed generic ${\mathbb{Z}}_2$-symmetric PEPS of larger bond dimension (up to $D=7$). We found that, under wavefunction optimization, spinons condense and, simultaneously, topological vison excitations get confined, hence precluding ${\mathbb{Z}}_2$ topological order. This strongly indicates the gapless (or critical) nature of the QSL phase, which is most naturally consistent with a U(1) Dirac spin liquid scenario.

12 pages, 10 figures