most citedAlpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning

75 citations · 75 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2022★ 75 cited

Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning

Lianmin Zheng, Zhuohan Li, Hao Zhang +9

Alpa automates model-parallel training of large deep learning (DL) models by generating execution plans that unify data, operator, and pipeline parallelism. Existing model-parallel…