1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Size Zheng, Xuegui Zheng, Hanshi Sun +16
The scaling of large language models (LLMs) is currently bottlenecked by the rigidity of distributed programming. While high-performance libraries like CuBLAS and NCCL provide opti…