Scalable Benchmarks for Gate-Based Quantum Computers
arXiv:2104.10698
Abstract
In the near-term "NISQ"-era of noisy, intermediate-scale, quantum hardware and beyond, reliably determining the quality of quantum devices becomes increasingly important: users need to be able to compare them with one another, and make an estimate whether they are capable of performing a given task ahead of time. In this work, we develop and release an advanced quantum benchmarking framework in order to help assess the state of the art of current quantum devices. Our testing framework measures the performance of universal quantum devices in a hardware-agnostic way, with metrics that are aimed to facilitate an intuitive understanding of which device is likely to outperform others on a given task. This is achieved through six structured tests that allow for an immediate, visual assessment of how devices compare. Each test is designed with scalability in mind, making this framework not only suitable for testing the performance of present-day quantum devices, but also of those released in the foreseeable future. The series of tests are motivated by real-life scenarios, and therefore emphasise the interplay between various relevant characteristics of quantum devices, such as qubit count, connectivity, and gate and measurement fidelity. We present the benchmark results of twenty-one different quantum devices from IBM, Rigetti and IonQ.
arXiv comment54 pages, many figures
References in corpus (17)
- Quantum algorithm for solving linear systems of equations
- Validating quantum computers using randomized model circuits
- Synthesis of Quantum Logic Circuits
- Quantum algorithm for systems of linear equations with exponentially improved dependence on precision
- Experimental Comparison of Two Quantum Computing Architectures
- Quantum-state preparation with universal gate decompositions
- Creating superpositions that correspond to efficiently integrable probability distributions
- Quantum circuits with uniformly controlled one-qubit gates
- Probing context-dependent errors in quantum processors
- Variable time amplitude amplification and a faster quantum algorithm for solving systems of linear equations
- Demonstration of quantum volume 64 on a superconducting quantum computing system
- Quantum circuits for maximally entangled states
- Hamiltonian Simulation by Uniform Spectral Amplification
- Complex chaos in the conditional dynamics of qubits
- Measurement induced chaos with entangled states
- On preparing ground states of gapped Hamiltonians: An efficient Quantum Lovász Local Lemma
- Quantum Jumps, EEQT and the Five Platonic Fractals
Cited by in corpus (10)
- Application-Oriented Performance Benchmarks for Quantum Computing
- Quantum Volume in Practice: What Users Can Expect from NISQ Devices
- Benchmarking quantum computers
- Re-examining the quantum volume test: Ideal distributions, compiler optimizations, confidence intervals, and scalable resource estimations
- Benchmarking of Different Optimizers in the Variational Quantum Algorithms for Applications in Quantum Chemistry
- HamLib: A library of Hamiltonians for benchmarking quantum algorithms and hardware
- Quantum algorithms for scientific computing
- Testing quantum computers with the protocol of quantum state matching
- An Energy Estimation Benchmark for Quantum Computers
- PyQBench: a Python library for benchmarking gate-based quantum computers