Faster Multi-GPU Training with PPLL: A Pipeline Parallelism Framework Leveraging Local Learning

Xiuyuan Guo, Chengqi Xu, Guinan Guo +6

Currently, training large-scale deep learning models is typically achieved through parallel training across multiple GPUs. However, due to the inherent communication overhead and s…