Tally: Non-Intrusive Performance Isolation for Concurrent Deep Learning Workloads

Wei Zhao, Anand Jayarajan, Gennady Pekhimenko

GPU underutilization is a significant concern in many production deep learning clusters, leading to prolonged job queues and increased operational expenses. A promising solution to…