CCCL: Node-Spanning GPU Collectives with CXL Memory Pooling

Dong Xu, Han Meng, Xinyu Chen +11

Large language models (LLMs) training or inference across multiple nodes introduces significant pressure on GPU memory and interconnect bandwidth. The Compute Express Link (CXL) sh…