2 citations · 7 across the 42 of their papers we have counts for
1 paper · 1 filter
Mengshi Qi, Jiaxuan Peng, Jie Zhang +3
In the machine learning system, the hybrid model parallelism combining tensor parallelism (TP) and pipeline parallelism (PP) has become the dominant solution for distributed traini…