3 papers
cs.SE2026
VITAL-RAG: Invariance Race for Context Allocation in Coding Agents
Zijian Lu, Yonghua Lu, Mingcai Chen +4
Coding agents often retrieve code from an entire repository, but only limited evidence can fit into the final model input. Conventional retrieval-augmented generation (RAG) for cod…
cs.DC2025
Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices
Xiangyu Li, Chengyu Yin, Weijun Wang +3
Large language models (LLMs) are increasingly deployed on edge devices. To meet strict resource constraints, real-world deployment has pushed LLM quantization from 8-bit to 4-bit,…
cs.CL2025
KVShare: An LLM Service System with Efficient and Effective Multi-Tenant KV Cache Reuse
Huan Yang, Renji Zhang, Mingzhe Huang +5
Recent advances in long-text understanding have pushed the context length of large language models (LLMs) up to one million tokens. It boosts LLMs's accuracy and reasoning capacity…