Optimal Resource Efficiency with Fairness in Heterogeneous GPU Clusters

Zizhao Mo, Huanle Xu, Wing Cheong Lau

Ensuring the highest training throughput to maximize resource efficiency, while maintaining fairness among users, is critical for deep learning (DL) training in heterogeneous GPU c…