Two-dimensional Sparse Parallelism for Large Scale Deep Learning Recommendation Model Training

Xin Zhang, Quanyu Zhu, Liangbei Xu +8

The increasing complexity of deep learning recommendation models (DLRM) has led to a growing need for large-scale distributed systems that can efficiently train vast amounts of dat…