From the 1 of 4 linked papers with an AI index.
4 papers
StrataCL: Fabric-Native Communication Library for Production Supernodes
Tiancheng Hu, Jin Qin, Yuzheng Wang +14
StrataCL is a communication library for large‑scale AI workloads on supernode clusters that removes redundant data copies by enabling direct user‑buffer communication and uses NPU‑…
Indexing the Unreadable: LLM-Native Recursive Construction and Search of Service Taxonomies
Wei Zheng, Yang Yan, Yiyang Shao +6
The era of the Internet of Agents (IoA) is taking shape: LLM agents are expected to fulfill user goals by orchestrating fast-growing populations of Model Context Protocol (MCP) ser…
Exploiting Multicast for Accelerating Collective Communication
Chao Xu, Xu Zhang, Zihang Luo +5
Reducing collective communication latency is a critical goal for large model training and inference in both academia and industry. Many-to-many communications, such as AllGather an…
Relay Buffer Independent Communication over Pooled HBM for Efficient MoE Inference on Ascend
Tianlun Hu, Tiancheng Hu, Shengsheng Litang +8
Mixture-of-Experts (MoE) inference requires large-scale token exchange across devices, making dispatch and combine major bottlenecks in both prefill and decode. Beyond network tran…