Dynamic Solutions for Hybrid Quantum-HPC Resource Allocation

Abstract

The integration of quantum computers within classical High-Performance Computing (HPC) infrastructures is receiving increasing attention, with the former expected to serve as accelerators for specific computational tasks. However, combining HPC and quantum computers presents significant technical challenges, including resource allocation. This paper presents a novel malleability-based approach, alongside a workflow-based strategy, to optimize resource utilization in hybrid HPC-quantum workloads. With both these approaches, we can release classical resources when computations are offloaded to the quantum computer and reallocate them once quantum processing is complete. Our experiments with a hybrid HPC-quantum use case show the benefits of dynamic allocation, highlighting the potential of those solutions.

7 pages, accepted to QCE25 WIHPQC Workshop (The Fifth International Workshop on Integrating High-Performance and Quantum Computing)

References in corpus (8)

• Integrating Quantum Computing Resources into Scientific HPC Ecosystems
• DMRlib: Easy-coding and Efficient Resource Management for Job Malleability
• DMR API: Improving cluster productivity by turning applications into malleable
• A Terminology for Scientific Workflow Systems
• Resource Optimization with MPI Process Malleability for Dynamic Workloads in HPC Clusters
• BBQ-mIS: a parallel quantum algorithm for graph coloring problems
• Introducing SWIRL: An Intermediate Representation Language for Scientific Workflows
• Towards the Democratization and Standardization of Dynamic Resources with MPI Spawning