Adaptive Elastic Training for Sparse Deep Learning on Heterogeneous Multi-GPU Servers

Yujing Ma, Florin Rusu, Kesheng Wu +1

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zer…