QASMBench: A Low-level QASM Benchmark Suite for NISQ Evaluation and Simulation
arXiv:2005.13018
Abstract
The rapid development of quantum computing (QC) in the NISQ era urgently demands a low-level benchmark suite and insightful evaluation metrics for characterizing the properties of prototype NISQ devices, the efficiency of QC programming compilers, schedulers and assemblers, and the capability of quantum system simulators in a classical computer. In this work, we fill this gap by proposing a low-level, easy-to-use benchmark suite called QASMBench based on the OpenQASM assembly representation. It consolidates commonly used quantum routines and kernels from a variety of domains including chemistry, simulation, linear algebra, searching, optimization, arithmetic, machine learning, fault tolerance, cryptography, etc., trading-off between generality and usability. To analyze these kernels in terms of NISQ device execution, in addition to circuit width and depth, we propose four circuit metrics including gate density, retention lifespan, measurement density, and entanglement variance, to extract more insights about the execution efficiency, the susceptibility to NISQ error, and the potential gain from machine-specific optimizations. Applications in QASMBench can be launched and verified on several NISQ platforms, including IBM-Q, Rigetti, IonQ and Quantinuum. For evaluation, we measure the execution fidelity of a subset of QASMBench applications on 12 IBM-Q machines through density matrix state tomography, which comprises 25K circuit evaluations. We also compare the fidelity of executions among the IBM-Q machines, the IonQ QPU and the Rigetti Aspen M-1 system. QASMBench is released at: http://github.com/pnnl/QASMBench.
References in corpus (18)
- Supplementary information for "Quantum supremacy using a programmable superconducting processor"
- The Quantum Internet
- Experimental quantum teleportation
- Quantum cryptography: Public key distribution and coin tossing
- Quantum algorithm for solving linear systems of equations
- Surface codes: Towards practical large-scale quantum computation
- Photonic quantum technologies
- A Quantum Approximate Optimization Algorithm
- Robust randomized benchmarking of quantum processes
- Superconducting qubit in waveguide cavity with coherence time approaching 0.1ms
- A new quantum ripple-carry addition circuit
- Resource-Aware Quantum Programming with General Recursion and Quantum Control
- Software Mitigation of Crosstalk on Noisy Intermediate-Scale Quantum Computers
- Optimized Compilation of Aggregated Instructions for Realistic Quantum Computers
- Benchmarking gate-based quantum computers
- Random circuit block-encoded matrix and a proposal of quantum LINPACK benchmark
- Identification of networking quantum teleportation on 14-qubit IBM universal quantum computer
- A quantum teleportation experiment for undergraduate students
Cited by in corpus (13)
- Neutral Atom Quantum Computing Hardware: Performance and End-User Perspective
- Benchmarking quantum computers
- Simultaneous execution of quantum circuits on current and near-future NISQ systems
- QUARK: A Framework for Quantum Computing Application Benchmarking
- A compiler for universal photonic quantum computers
- -QER: An Intelligent Approach towards Quantum Error Reduction
- Robust and Resource-Efficient Quantum Circuit Approximation
- FragQC: An Efficient Quantum Error Reduction Technique using Quantum Circuit Fragmentation
- MIRAGE: Quantum Circuit Decomposition and Routing Collaborative Design using Mirror Gates
- Q-gen: A Parameterized Quantum Circuit Generator
- State of practice: evaluating GPU performance of state vector and tensor network methods
- Analyzing crosstalk error in the NISQ era
- QSSA: An SSA-based IR for Quantum Computing