A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability

Ruitao Liu, Xinyang Tian, Shuo Chen +4

Pipeline parallelism is a key technique for scaling large-model training, but modern workloads exhibit runtime variability in computation and communication. Existing pipeline syste…