Semantic-Aware Scheduling for GPU Clusters with Large Language Models

Zerui Wang, Qinghao Hu, Ana Klimovic +4

Deep learning (DL) schedulers are pivotal in optimizing resource allocation in GPU clusters, but operate with a critical limitation: they are largely blind to the semantic context…