2 papers
cs.DC2025
MultiPath Memory Access: Breaking Host-GPU Bandwidth Bottlenecks in LLM Services
Lingfeng Tang, Daoping Zhang, Junjie Chen +6
Host-GPU data movement has become a latency-critical bottleneck in LLM serving, surfacing in common paths such as model-weight movement and KV cache offload/fetch. Today, each host…
cs.NI2023
NP-RDMA: Using Commodity RDMA without Pinning Memory
Huijun Shen, Guo Chen, Bojie Li +10
Remote Direct Memory Access (RDMA) has been haunted by the need of pinning down memory regions. Pinning limits the memory utilization because it impedes on-demand paging and swappi…