activity
20102026
most citedExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

3.7k citations · 11.6k across the 43 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2021★ 38 cited

GSPMD: General and Scalable Parallelization for ML Computation Graphs

Yuanzhong Xu, HyoukJoong Lee, Dehao Chen +13

We present GSPMD, an automatic, compiler-based parallelization system for common machine learning computations. It allows users to write programs in the same way as for a single de…