A Practical Introduction to Benchmarking and Characterization of Quantum Computers

Abstract

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV's core models and concepts -- quantum states, measurements, and processes -- and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

References in corpus (263)

• Supplementary information for "Quantum supremacy using a programmable superconducting processor"
• Quantum algorithm for solving linear systems of equations
• Variational Quantum Algorithms
• Quantum-enhanced measurements: beating the standard quantum limit
• Quantum computational advantage using photons
• Circuit Quantum Electrodynamics
• Introduction to Quantum Noise, Measurement and Amplification
• Logic gates at the surface code threshold: Superconducting qubits poised for fault-tolerant quantum computing
• Improved Simulation of Stabilizer Circuits
• Quantum Convolutional Neural Networks
• Measure for the Degree of Non-Markovian Behavior of Quantum Processes in Open Systems
• Non-Markovian dynamics in open quantum systems
• Quantum Error Correction for Quantum Memories
• Characterizing Quantum Supremacy in Near-Term Devices
• Predicting Many Properties of a Quantum System from Very Few Measurements
• Strong quantum computational advantage using a superconducting quantum processor
• Suppressing quantum errors by scaling a surface code logical qubit
• Quantum state tomography via compressed sensing
• Symmetric Informationally Complete Quantum Measurements
• Randomized Benchmarking of Quantum Gates
• Quantum Non-Markovianity: Characterization, Quantification and Detection
• Robust randomized benchmarking of quantum processes
• A simple formula for the average gate fidelity of a quantum dynamical operation
• Validating quantum computers using randomized model circuits
• Efficient quantum state tomography
• Resonance Fluorescence of a Single Artificial Atom
• Exact and Approximate Unitary 2-Designs: Constructions and Applications
• Distance measures to compare real and ideal quantum processes
• Parallel implementation of high-fidelity multi-qubit gates with neutral atoms
• Assessing non-Markovian dynamics
• Experimental control of the transition from Markovian to non-Markovian dynamics of open quantum systems
• Efficient Z-Gates for Quantum Computing
• A rigorous and robust quantum speed-up in supervised machine learning
• Computing with spin qubits at the surface code error threshold
• Noise tailoring for scalable quantum computation via randomized compiling
• Practical Quantum Error Mitigation for Near-Future Applications
• Scalable Noise Estimation with Random Unitary Operators
• Quantum process tomography of a controlled-NOT gate
• Direct Fidelity Estimation from Few Pauli Measurements
• Quantum probabilities as Bayesian probabilities
• Characterizing Quantum Gates via Randomized Benchmarking
• A blueprint for demonstrating quantum supremacy with superconducting qubits
• Robust determination of molecular spectra on a quantum processor
• Efficient measurement of quantum gate error by interleaved randomized benchmarking
• Observing single quantum trajectories of a superconducting qubit
• Demonstration of qubit operations below a rigorous fault tolerance threshold with gate set tomography
• Optimal, reliable estimation of quantum states
• Implementation of a Toffoli Gate with Superconducting Circuits
• Complete universal quantum gate set approaching fault-tolerant thresholds with superconducting qubits
• Measuring measurement
• A universal qudit quantum processor with trapped ions
• The randomized measurement toolbox
• Evenly distributed unitaries: on the structure of unitary designs
• Observation of Time-Crystalline Eigenstate Order on a Quantum Processor
• Mitigating measurement errors in multi-qubit experiments
• Concepts of quantum non-Markovianity: a hierarchy
• Quantum certification and benchmarking
• Quantum state discrimination and its applications
• Single ion-qubit exceeding one hour coherence time
• Non-Markovian quantum jumps
• Reconstructing quantum states with generative models
• Practical characterization of quantum devices without tomography
• Characterization of addressability by simultaneous randomized benchmarking
• Self-Consistent Quantum Process Tomography
• Single-shot qubit readout in circuit Quantum Electrodynamics
• Single-shot qubit readout in circuit Quantum Electrodynamics
• Probabilistic error cancellation with sparse Pauli-Lindblad models on noisy quantum processors
• Implementing a strand of a scalable fault-tolerant quantum computing fabric
• Quantum back-action of variable-strength measurement
• Maximum Likelihood, Minimum Effort
• Rapid high-fidelity multiplexed readout of superconducting qubits
• Measuring and Suppressing Quantum State Leakage in a Superconducting Qubit
• Quantum Information Scrambling in a Superconducting Qutrit Processor
• Characterizing large-scale quantum computers via cycle benchmarking
• Precision tomography of a three-qubit donor quantum processor in silicon
• Permutationally invariant quantum tomography
• Complete 3-Qubit Grover Search on a Programmable Quantum Computer
• Suppression of Qubit Crosstalk in a Tunable Coupling Superconducting Circuit
• Hot non-equilibrium quasiparticles in transmon qubits
• Process verification of two-qubit quantum gates by randomized benchmarking
• Mapping the optimal route between two quantum states
• Efficient learning of quantum noise
• Gate Set Tomography
• Reliable Quantum State Tomography
• Environment - Assisted Invariance, Causality, and Probabilities in Quantum Physics
• Estimating the Coherence of Noise
• Efficient estimation of Pauli observables by derandomization
• Improving Quantum State Estimation with Mutually Unbiased Bases
• Heralded state preparation in a superconducting qubit
• Multiqubit Clifford groups are unitary 3-designs
• Manipulating biphotonic qutrits
• Quantification and Characterization of Leakage Errors
• Quantum stochastic processes and quantum non-Markovian phenomena
• Maximum-likelihood estimation of quantum measurement
• Adaptive Bayesian Quantum Tomography
• Repetition Cat Qubits for Fault-Tolerant Quantum Computation
• Tomography and Generative Data Modeling via Quantum Boltzmann Training
• Randomized Benchmarking with Confidence
• Magic state distillation in all prime dimensions using quantum Reed-Muller codes
• Experimental Machine Learning of Quantum States
• Learning Quantum Systems
• Dynamics of simultaneously measured non-commuting observables
• Three Qubit Randomized Benchmarking
• Characterizing errors on qubit operations via iterative randomized benchmarking
• Variational Quantum Eigensolver with Fewer Qubits
• Measuring the Capabilities of Quantum Computers
• Dispersive measurements of superconducting qubit coherence with a fast, latching readout
• Experimental quantum compressed sensing for a seven-qubit system
• Quantifying the quantum gate fidelity of single-atom spin qubits in silicon by randomized benchmarking
• Application-Oriented Performance Benchmarks for Quantum Computing
• Qutrit randomized benchmarking
• High-Fidelity Qutrit Entangling Gates for Superconducting Circuits
• Theory of quantum system certification: a tutorial
• Investigating the limits of randomized benchmarking protocols
• Detector Tomography on IBM 5-qubit Quantum Computers and Mitigation of Imperfect Measurement
• A general framework for randomized benchmarking
• Comparing Experiments to the Fault-Tolerance Threshold
• Realization of a $\Lambda$ system with metastable states of a capacitively-shunted fluxonium
• What randomized benchmarking actually measures
• Diagnosis, prescription and prognosis of a Bell-state filter by quantum process tomography
• Permutationally invariant state reconstruction
• Fisher Information in Noisy Intermediate-Scale Quantum Applications
• A practical and efficient approach for Bayesian quantum state estimation
• Efficient estimation of Pauli channels
• High fidelity two-qubit gates on fluxoniums using a tunable coupler
• Scalable reconstruction of density matrices
• Direct randomized benchmarking for multi-qubit devices
• Minimal Informationally Complete Measurements for Pure States
• Native qudit entanglement in a trapped ion quantum processor
• Protecting a superconducting qubit from energy decay by selection rule engineering
• Two-level systems in superconducting quantum devices due to trapped quasiparticles
• Hadamard-free circuits expose the structure of the Clifford group
• Practical Bayesian Tomography
• High-fidelity three-qubit iToffoli gate for fixed-frequency superconducting qubits
• Asymptotic Improvements to Quantum Circuits via Qutrits
• Hedged maximum likelihood estimation
• Characterizing Universal Gate Sets via Dihedral Benchmarking
• Complementary classical fidelities as an efficient criterion for the evaluation of experimentally realized quantum operations
• Benchmarking a trapped-ion quantum computer with 30 qubits
• Detecting and tracking drift in quantum information processors
• High-contrast ZZ interaction using superconducting qubits with opposite-sign anharmonicity
• Scalable High-Performance Fluxonium Quantum Processor
• Randomized benchmarking with gate-dependent noise
• Experimental Adaptive Bayesian Tomography
• Formation of robust bound states of interacting microwave photons
• A volumetric framework for quantum computer benchmarks
• Quantum process tomography via completely positive and trace-preserving projection
• Efficient Decoders for Qudit Topological Codes
• High-fidelity measurement of qubits encoded in multilevel superconducting circuits
• Hardware-Efficient Microwave-Activated Tunable Coupling Between Superconducting Qubits
• Resilient entanglement gates for trapped ions
• Experimental single-setting quantum state tomography
• Quantifying error and leakage in an encoded Si/SiGe triple-dot qubit
• A polynomial-time classical algorithm for noisy random circuit sampling
• Scalable randomized benchmarking of quantum computers using mirror circuits
• Experimental Comparison of Efficient Tomography Schemes for a Six-Qubit State
• Non-Markovian qubit dynamics in the presence of 1/f noise
• Benchmarking Coherent Errors in Controlled-Phase Gates due to Spectator Qubits
• How to efficiently select an arbitrary Clifford group element
• Understanding the effects of leakage in superconducting quantum error detection circuits
• Non-exponential Fidelity Decay in Randomized Benchmarking with Low-Frequency Noise
• Capturing Non-Markovian Dynamics on Near-Term Quantum Computers
• Fast high fidelity quantum non-demolition qubit readout via a non-perturbative cross-Kerr coupling
• Characterization of Leakage Errors via Randomized Benchmarking
• Probing quantum processor performance with pyGSTi
• Optimization of a solid-state electron spin qubit using Gate Set Tomography
• Robustness of dynamical decoupling sequences
• Benchmarking quantum computers
• Overcoming erasure errors with multilevel systems
• Non-Markovian quantum dynamics: What does it mean?
• Quantum error correction of coherent errors by randomization
• Scalable algorithm simplification using quantum AND logic
• Gate fidelity fluctuations and quantum process invariants
• Programmable Heisenberg interactions between Floquet qubits
• Evaluating energy differences on a quantum computer with robust phase estimation
• Shorter stabilizer circuits via Bruhat decomposition and quantum circuit transformations
• Identification and Distance Measures of Measurement Apparatus
• Shadow process tomography of quantum channels
• Kitaev's Z_d-Codes Threshold Estimates
• NLTS Hamiltonians from good quantum codes
• Real Randomized Benchmarking
• Performing SU($d$) operations and rudimentary algorithms in a superconducting transmon qudit for $d=3$ and $d=4$
• Classically-Verifiable Quantum Advantage from a Computational Bell Test
• Practical adaptive quantum tomography
• Accelerated Randomized Benchmarking
• Quantum Bayesian approach to circuit QED measurement with moderate bandwidth
• Statistical analysis of randomized benchmarking
• Direct Fidelity Estimation of Quantum States using Machine Learning
• Scalable Method for Eliminating Residual $ZZ$ Interaction between Superconducting Qubits
• Matchgate benchmarking: Scalable benchmarking of a continuous family of many-qubit gates
• Robust Characterization of Loss Rates
• Estimating the coherence of noise in quantum control of a solid-state qubit
• Bounding the average gate fidelity of composite channels using the unitarity
• A taxonomy of small Markovian errors
• Projected Least-Squares Quantum Process Tomography
• The learnability of Pauli noise
• Randomized Benchmarking with Restricted Gate Sets
• Estimating the fidelity of T gates using standard interleaved randomized benchmarking
• A complete Randomized Benchmarking Protocol accounting for Leakage Errors
• Simple master equations for describing driven systems subject to classical non-Markovian noise
• Experimental demonstration of cheap and accurate phase estimation
• Mutually unbiased bases: tomography of spin states and star-product scheme
• Pure State Tomography with Pauli Measurements
• Real-time calibration with spectator qubits
• Rank-based model selection for multiple ions quantum tomography
• Accrediting outputs of noisy intermediate-scale quantum computing devices
• Implementing and characterizing precise multi-qubit measurements
• Practical learning method for multi-scale entangled states
• Eliminating Leakage Errors in Hyperfine Qubits
• From randomized benchmarking experiments to gateset circuit fidelity: how to interpret randomized benchmarking decay parameters
• Approximate Randomized Benchmarking for Finite Groups
• A metastable superconducting qubit
• Character randomized benchmarking for non-multiplicity-free groups with applications to subspace, leakage, and matchgate randomized benchmarking
• Characterizing the Reproducibility of Noisy Quantum Circuits
• Process tomography for unitary quantum channels
• Empowering high-dimensional quantum computing by traversing the dual bosonic ladder
• Experimental implementation of non-Clifford interleaved randomized benchmarking with a controlled-S gate
• Learning correlated noise in a 39-qubit quantum processor
• Benchmarking digital quantum simulations above hundreds of qubits using quantum critical dynamics
• Progress toward scalable tomography of quantum maps using twirling-based methods and information hierarchies
• Efficiently improving the performance of noisy quantum computers
• Estimating gate-set properties from random sequences
• Compressive gate set tomography
• Generalized canonical purification for density matrix minimization
• Emulating two qubits with a four-level transmon qudit for variational quantum algorithms
• State leakage during fast decay and control of a superconducting transmon qubit
• Long-lived topological time-crystalline order on a quantum processor
• Demonstrating scalable randomized benchmarking of universal gate sets
• Exploring Ququart Computation on a Transmon using Optimal Control
• Integration of spectator qubits into quantum computer architectures for hardware tuneup and calibration
• HamLib: A library of Hamiltonians for benchmarking quantum algorithms and hardware
• Reducing resources for verification of quantum computations
• Global triplewise information trade-off in quantum measurement
• Spectral Quantum Tomography
• Parallel tomography of quantum non-demolition measurements in multi-qubit devices
• Implementing generalized measurements with superconducting qubits
• Selective and Efficient Quantum State Tomography and its Application to Quantum Process Tomography
• Operational, gauge-free quantum tomography
• Benchmarking quantum logic operations relative to thresholds for fault tolerance
• An efficient quantum algorithm for spectral estimation
• Scalable noise characterization of syndrome-extraction circuits with averaged circuit eigenvalue sampling
• Fully scalable randomized benchmarking without motion reversal
• Practical and efficient experimental characterization of multiqubit stabilizer states
• Efficient Bayesian credible-region certification for quantum-state tomography
• Quasi-Probabilistic Readout Correction of Mid-Circuit Measurements for Adaptive Feedback via Measurement Randomized Compiling
• Techniques for learning sparse Pauli-Lindblad noise models
• Direct estimation of minimum gate fidelity
• A generalized cycle benchmarking algorithm for characterizing mid-circuit measurements
• Complete physical characterization of QND measurements via tomography
• Efficient characterization of qudit logical gates with gate set tomography using an error-free Virtual-Z-gate model
• Randomized linear gate set tomography
• Consistency testing for robust phase estimation
• Linear Cross Entropy Benchmarking with Clifford Circuits
• Maximum a posteriori estimation of quantum states
• Probing quantum state space: does one have to learn everything to learn something?
• Changes in electric-field noise due to thermal transformation of a surface ion trap
• Context Aware Fidelity Estimation
• Estimating the bias of CX gates via character randomized benchmarking
• Experimentally efficient methods for estimating the performance of quantum measurements
• Near-Minimal Gate Set Tomography Experiment Designs
• Streaming quantum gate set tomography using the extended Kalman filter
• Estimating Coherent Contributions to the Error Profile Using Cycle Error Reconstruction
• Scalable Full-Stack Benchmarks for Quantum Computers

Cited by in corpus (10)

• Benchmarking quantum computers
• Efficient self-consistent learning of gate set Pauli noise
• Hands-on Introduction to Randomized Benchmarking
• The Role of Quantum Computing in Advancing Scientific High-Performance Computing: A perspective from the ADAC Institute
• Resource-Efficient Cross-Platform Verification with Modular Superconducting Devices
• Efficient Generation of Multi-partite Entanglement between Non-local Superconducting Qubits using Classical Feedback
• A Mathematical Structure for Amplitude-Mixing Error-Transparent Gates for Binomial Codes
• Multi-GPU Quantum Circuit Simulation and the Impact of Network Performance
• Selective and efficient quantum state tomography for multi-qubit systems
• Quantum Process Tomography with Digital Twins of Error Matrices