most citedRethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem

2 citations · 4 across the 2 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2023★ 2 cited

SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction

Zhiqi Lin, Youshan Miao, Guodong Liu +10

With the growing model size, deep neural networks (DNN) are increasingly trained over massive GPU accelerators, which demands a proper parallelization plan that transforms a DNN mo…