Benchmarking the performance of quantum computing software
arXiv:2409.08844 · doi:10.1038/s43588-025-00792-y
Abstract
We present Benchpress, a benchmarking suite for evaluating the performance and range of functionality of multiple quantum computing software development kits. This suite consists of a collection of over tests measuring key performance metrics for a wide variety of operations on quantum circuits comprised of up to qubits and two-qubit gates, as well as an execution framework for running the tests over multiple quantum software packages in a unified manner. We give a detailed overview of the benchmark suite, its methodology, and generate representative results over seven different quantum software packages. The flexibility of the Benchpress framework allows for benchmarking that not only keeps pace with quantum hardware improvements but can preemptively gauge the quantum circuit processing costs of future device architectures. Being open-source, Benchpress ensures the transparency and verification of performance claims.
17 pages, 8 figures, 5 tables
References in corpus (21)
- Logical quantum processor based on reconfigurable atom arrays
- Validating quantum computers using randomized model circuits
- Quantum error correction below the surface code threshold
- Noise tailoring for scalable quantum computation via randomized compiling
- tket : A Retargetable Compiler for NISQ Devices
- MQT Bench: Benchmarking Software and Design Automation Tools for Quantum Computing
- Towards Large-scale Functional Verification of Universal Quantum Circuits
- Efficient Long-Range Entanglement using Dynamic Circuits
- Hadamard-free circuits expose the structure of the Clifford group
- staq -- A full-stack quantum processing toolkit
- Simulating large-size quantum spin chains on cloud-based superconducting quantum computers
- Realizing the Nishimori transition across the error threshold for constant-depth quantum circuits
- rustworkx: A High-Performance Graph Library for Python
- Benchmarking digital quantum simulations above hundreds of qubits using quantum critical dynamics
- Uncovering Local Integrability in Quantum Many-Body Dynamics
- Scaling Whole-Chip QAOA for Higher-Order Ising Spin Glass Models on Heavy-Hex Graphs
- Quantum Circuit Synthesis and Compilation Optimization: Overview and Prospects
- Bias-field digitized counterdiabatic quantum optimization
- Integrated error-suppressed pipeline for quantum optimization of nontrivial binary combinatorial optimization problems on gate-model hardware at the 156-qubit scale
- Practical and efficient quantum circuit synthesis and transpiling with Reinforcement Learning
- Quantum reservoir computing with repeated measurements on superconducting devices