Showing 2026Show all
3 papers · 1 filter
cs.OS2026
Adaptive Context Parallelism for Production LLM Serving
Jiarui Guo, Rongle Wang, Peijun Huang +7
As LLM context windows expand and input sequences grow longer, serving systems face increasing computational and memory demands. Context parallelism (CP), which partitions the inpu…
cs.LG2026
Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
Ruijie Miao, Zhiming Wang, Wang Li +4
Key-value (KV) caching is widely used to accelerate transformer inference, but its memory cost grows linearly with input length, limiting long-context deployment. Existing token ev…
cs.IR2026
Rethinking Retrieval-Augmentation as Synthesis: A Query-Aware Context Merging Approach
Jiarui Guo, Yuemeng Xu, Zongwei Lv +6
Retrieval-Augmented Generation (RAG) enables Large Language Models (LLMs) to extend their existing knowledge by dynamically incorporating external information. However, practical d…