DeepShare: Assurance-Driven Deep Learning Job Scheduling for Multi-Tenant Clusters

Jinghao Wang, Yihang Zhou, Xiao Zhou +5

Multi-tenant GPU clusters frequently remain underutilized even when tenants experience long queueing delays, because quota control, queue ordering, preemption, and GPU sharing are…