most citedtorchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models

32 citations · 32 across the 1 of their papers we have counts for

collaborators
Showing cs.HCShow all

1 paper · 1 filter

cs.HC2023

HPCClusterScape: Increasing Transparency and Efficiency of Shared High-Performance Computing Clusters for Large-scale AI Models

Heungseok Park, Aeree Cho, Hyojun Jeon +5

The emergence of large-scale AI models, like GPT-4, has significantly impacted academia and industry, driving the demand for high-performance computing (HPC) to accelerate workload…