2 papers
cs.DC2026
MultiPath Memory Access: Breaking Host-GPU Bandwidth Bottlenecks in LLM Services
Lingfeng Tang, Daoping Zhang, Junjie Chen +6
Host-GPU data movement has become a latency-critical bottleneck in LLM serving, surfacing in common paths such as model-weight movement and KV cache offload/fetch. Today, each host…
cs.CL2026
LIRAG: A Lightweight Rerank Reasoning Strategy Framework for Retrieval-Augmented Generation
Guo Chen, Junjie Huang, Huaijin Xie +2
Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models i…