Neural network agent playing spin Hamiltonian games on a quantum computer

Abstract

Quantum computing is expected to provide new promising approaches for solving the most challenging problems in material science, communication, search, machine learning and other domains. However, due to the decoherence and gate imperfection errors modern quantum computer systems are characterized by a very complex, dynamical, uncertain and fluctuating computational environment. We develop an autonomous agent effectively interacting with such an environment to solve magnetism problems. By using the reinforcement learning the agent is trained to find the best-possible approximation of a spin Hamiltonian ground state from self-play on quantum devices. We show that the agent can learn the entanglement to imitate the ground state of the quantum spin dimer. The experiments were conducted on quantum computers provided by IBM. To compensate the decoherence we use local spin correction procedure derived from a general sum rule for spin-spin correlation functions of a quantum system with even number of antiferromagnetically-coupled spins in the ground state. Our study paves a way to create a new family of the neural network eigensolvers for quantum computers.

arXiv commentLocal spin correction procedure was used to compensate real device errors; comparison with variational approach was added

References in corpus (19)

• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• Scalable Quantum Simulation of Molecular Energies
• Towards Practical Quantum Variational Algorithms
• Reinforcement Learning in Different Phases of Quantum Control
• Active learning machine learns to create new quantum experiments
• An Artificial Neuron Implemented on an Actual Quantum Processor
• Learning the quantum algorithm for state overlap
• Implementing a distance-based classifier with a quantum interference circuit
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Experimental implementation of an adiabatic quantum optimization algorithm
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Deep Reinforcement Learning for Quantum Gate Control
• Quantum hardware simulating four-dimensional inelastic neutron scattering
• Neural Belief-Propagation Decoders for Quantum Error-Correcting Codes
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Algorithmic simulation of far-from-equilibrium dynamics using quantum computer
• Compressed quantum computation using the IBM Quantum Experience
• Modeling noise and error correction for Majorana-based quantum computing
• Is telegraph noise a good model for the environment of mesoscopic systems?

Cited by in corpus (5)

• Hybrid digital-analog simulation of many-body dynamics with superconducting qubits
• Certification of quantum states with hidden structure of their bitstrings
• Estimating Patterns of Classical and Quantum Skyrmion States
• Benchmarking a boson sampler with Hamming nets
• Exploring entanglement in finite-size quantum systems with degenerate ground state