TENSILE: A Tensor granularity dynamic GPU memory scheduling method toward multiple dynamic workloads system

Kaixin Zhang, Hongzhi Wang, Han Hu +4

Recently, deep learning has been an area of intense research. However, as a kind of computing-intensive task, deep learning highly relies on the scale of GPU memory, which is usual…