1 citations · 1 across the 4 of their papers we have counts for
1 paper · 2 filters
Hongpei Li, Han Zhang, Huikang Liu +2
Pipeline parallelism (PP) has become a standard technique for scaling large language model (LLM) training across multiple devices. However, despite recent progress in reducing memo…