An Online Fragmentation-Aware GPU Scheduler for Multi-Tenant MIG-based Clouds

Marco Zambianco, Lorenzo Fasol, Roberto Doriguzzi-Corin

The explosive growth of AI applications has created unprecedented demand for GPU resources. Cloud providers meet this demand through GPU-as-a-Service platforms that offer rentable…