3 citations · 5 across the 6 of their papers we have counts for
1 paper · 2 filters
Size Zheng, Xuegui Zheng, Hanshi Sun +16
The scaling of large language models (LLMs) is currently bottlenecked by the rigidity of distributed programming. While high-performance libraries like CuBLAS and NCCL provide opti…