activity
20222026
most citedDeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

8 citations · 9 across the 6 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2025★ 1 cited

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Masahiro Tanaka, Du Li, Umesh Chand +3

The rapid growth of deep learning models has increased the demand for efficient distributed training strategies. Fully sharded approaches like ZeRO-3 and FSDP partition model param…