Benchmarking quantum computers
arXiv:2407.08828 · doi:10.1038/s42254-024-00796-z
Abstract
The rapid pace of development in quantum computing technology has sparked a proliferation of benchmarks for assessing the performance of quantum computing hardware and software. Good benchmarks empower scientists, engineers, programmers, and users to understand a computing system's power, but bad benchmarks can misdirect research and inhibit progress. In this Perspective, we survey the science of quantum computer benchmarking. We discuss the role of benchmarks and benchmarking, and how good benchmarks can drive and measure progress towards the long-term goal of useful quantum computations, i.e., "quantum utility". We explain how different kinds of benchmark quantify the performance of different parts of a quantum computer, survey existing benchmarks, examine recent trends in benchmarking, and highlight important open research questions in this field.
Minor updates from V1. Close to published version
References in corpus (122)
- Quantum Computing in the NISQ era and beyond
- Supplementary information for "Quantum supremacy using a programmable superconducting processor"
- Noisy intermediate-scale quantum (NISQ) algorithms
- Logic gates at the surface code threshold: Superconducting qubits poised for fault-tolerant quantum computing
- Demonstration of Two-Qubit Algorithms with a Superconducting Quantum Processor
- Characterizing Quantum Supremacy in Near-Term Devices
- Suppressing quantum errors by scaling a surface code logical qubit
- Logical quantum processor based on reconfigurable atom arrays
- Randomized Benchmarking of Quantum Gates
- Elucidating Reaction Mechanisms on Quantum Computers
- Robust randomized benchmarking of quantum processes
- Hartree-Fock on a superconducting qubit quantum computer
- Validating quantum computers using randomized model circuits
- How to factor 2048 bit RSA integers in 8 hours using 20 million noisy qubits
- Quantum Error Mitigation
- Roads towards fault-tolerant universal quantum computation
- Surface code quantum computing by lattice surgery
- Demonstration of the trapped-ion quantum-CCD computer architecture
- Toward the first quantum simulation with quantum speedup
- Demonstration of multi-qubit entanglement and algorithms on a programmable neutral atom quantum computer
- Experimental Comparison of Two Quantum Computing Architectures
- Scalable Noise Estimation with Random Unitary Operators
- Quantum Approximate Optimization of Non-Planar Graph Problems on a Planar Superconducting Processor
- Restrictions on Transversal Encoded Quantum Gate Sets
- Efficient measurement of quantum gate error by interleaved randomized benchmarking
- Encoding Electronic Spectra in Quantum Circuits with Linear T Complexity
- A generative modeling approach for benchmarking and training shallow quantum circuits
- Quantum certification and benchmarking
- Experimental demonstration of Shor's algorithm with quantum entanglement
- Characterization of addressability by simultaneous randomized benchmarking
- Low-distance Surface Codes under Realistic Quantum Noise
- Even more efficient quantum computations of chemistry through tensor hypercontraction
- Symmetrised Characterisation of Noisy Quantum Processes
- Quantum computing enhanced computational catalysis
- Characterizing large-scale quantum computers via cycle benchmarking
- Is there evidence for exponential quantum advantage in quantum chemistry?
- Optimal quantum control using randomized benchmarking
- Magic State Distillation: Not as Costly as You Think
- Gate Set Tomography
- Detecting crosstalk errors in quantum information processors
- Benchmarking quantum control methods on a 12-qubit system
- MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing
- Challenges and Opportunities of Near-Term Quantum Computing Systems
- Quantification and Characterization of Leakage Errors
- Verification of quantum computation: An overview of existing approaches
- Cross-Platform Verification of Intermediate Scale Quantum Devices
- Three Qubit Randomized Benchmarking
- Computational advantage of quantum random sampling
- Measuring the Capabilities of Quantum Computers
- Efficient tensor network simulation of IBM's Eagle kicked Ising experiment
- Application-Oriented Performance Benchmarks for Quantum Computing
- Focus beyond quadratic speedups for error-corrected quantum advantage
- Reliably assessing the electronic structure of cytochrome P450 on today's classical computers and tomorrow's quantum computers
- Theory of quantum system certification: a tutorial
- Universal transversal gates with color codes - a simplified approach
- Adaptive hybrid optimal quantum control for imprecisely characterized systems
- A general framework for randomized benchmarking
- Pretending to factor large numbers on a quantum computer
- What randomized benchmarking actually measures
- The electronic complexity of the ground-state of the FeMo cofactor of nitrogenase as relevant to quantum simulations
- Direct randomized benchmarking for multi-qubit devices
- Encoding a magic state with beyond break-even fidelity
- Fault-tolerant resource estimate for quantum chemical simulations: Case study on Li-ion battery electrolyte molecules
- Compilation of Fault-Tolerant Quantum Heuristics for Combinatorial Optimization
- Benchmarking a trapped-ion quantum computer with 30 qubits
- Detecting and tracking drift in quantum information processors
- Theoretical and Experimental Perspectives of Quantum Verification
- Fast and converged classical simulations of evidence for the utility of quantum computing before fault tolerance
- Randomized benchmarking with gate-dependent noise
- A volumetric framework for quantum computer benchmarks
- Restless Tuneup of High-Fidelity Qubit Gates
- Scalable randomized benchmarking of quantum computers using mirror circuits
- Towards near-term quantum simulation of materials
- Benchmarking of Different Optimizers in the Variational Quantum Algorithms for Applications in Quantum Chemistry
- Simulating key properties of lithium-ion batteries with a fault-tolerant quantum computer
- QUARK: A Framework for Quantum Computing Application Benchmarking
- Benchmarking quantum co-processors in an application-centric, hardware-agnostic and scalable way
- Sample complexity of device-independently certified "quantum supremacy"
- QASMBench: A Low-level QASM Benchmark Suite for NISQ Evaluation and Simulation
- A taxonomy of small Markovian errors
- Application-Motivated, Holistic Benchmarking of a Full Quantum Computing Stack
- Analyzing Prospects for Quantum Advantage in Topological Data Analysis
- Random circuit block-encoded matrix and a proposal of quantum LINPACK benchmark
- Fault-tolerant quantum simulation of materials using Bloch orbitals
- Randomized benchmarking for non-Markovian noise
- Large-Scale Simulation of Shor's Quantum Factoring Algorithm
- Learning correlated noise in a 39-qubit quantum processor
- Bell sampling from quantum circuits
- Quantum computation of stopping power for inertial fusion target design
- Resource estimate for quantum many-body ground-state preparation on a quantum computer
- Controlling error orientation to improve quantum algorithm success rates
- Scalable Benchmarks for Gate-Based Quantum Computers
- A randomized benchmarking suite for mid-circuit measurements
- A quantum hamiltonian simulation benchmark
- Benchmarking Quantum Processor Performance at Scale
- A Practical Introduction to Benchmarking and Characterization of Quantum Computers
- Quantum simulation of battery materials using ionic pseudopotentials
- Evaluating the Q-score of Quantum Annealers
- Qibolab: an open-source hybrid quantum operating system
- Fault-tolerant quantum computation of molecular observables
- Arline Benchmarks: Automated Benchmarking Platform for Quantum Compilers
- Fully scalable randomized benchmarking without motion reversal
- Quantifying -gate-count improvements for ground-state-energy estimation with near-optimal state preparation
- VeriQBench: A Benchmark for Multiple Types of Quantum Circuits
- Randomized benchmarking with random quantum circuits
- Operational Markovianization in Randomized Benchmarking
- Establishing trust in quantum computations
- QPack Scores: Quantitative performance metrics for application-oriented quantum computer benchmarking
- Quantum computing for corrosion-resistant materials and anti-corrosive coatings design
- Quantum Computer Benchmarking via Quantum Algorithms
- Detailed assessment of calculating drag force with quantum computers: Explicit time-evolution precludes exponential advantage for nonlinear differential equations
- Feasibility of accelerating homogeneous catalyst discovery with fault-tolerant quantum computers
- Quantum Algorithm Exploration using Application-Oriented Performance Benchmarks
- Learning a quantum computer's capability
- Superconducting qubits in the millions: the potential and limitations of modularity
- Quantifying fault tolerant simulation of strongly correlated systems using the Fermi-Hubbard model
- Prospects for NMR Spectral Prediction on Fault-Tolerant Quantum Computers
- Scalable Full-Stack Benchmarks for Quantum Computers
- Achieving Energetic Superiority Through System-Level Quantum Circuit Simulation
- Quantum Resources Required for Binding Affinity Calculations of Amyloid beta
- Requirements for building effective Hamiltonians using quantum-enhanced density matrix downfolding
- Simulating X-ray absorption spectroscopy of battery materials on a quantum computer
Cited by in corpus (12)
- A Practical Introduction to Benchmarking and Characterization of Quantum Computers
- Resource-Efficient Cross-Platform Verification with Modular Superconducting Devices
- Quantum Optimization Benchmarking Library - The Intractable Decathlon
- Artificial intelligence for representing and characterizing quantum systems
- Topology-Aware Block Coordinate Descent for Qubit Frequency Allocation of Superconducting Quantum Processors
- The symplectic rank of non-Gaussian quantum states
- Benchmarking quantum devices beyond classical capabilities
- Accreditation Against Limited Adversarial Noise
- Quantum Process Tomography with Digital Twins of Error Matrices
- Multi-GPU Quantum Circuit Simulation and the Impact of Network Performance
- Benchmarking Single-Qubit Gates on a Neutral Atom Quantum Processor
- Quantum Resource Management in the NISQ Era: Challenges, Vision, and a Runtime Framework