2 papers
cs.LG2026
MetaKV: Adaptive KV Cache Compression for Constrained LLM Inference
Michael Wang, Keith Li, Roozbeh Bostandoost
Key--value (KV) cache compression is an effective way to reduce the memory overhead of large language model (LLM) inference, particularly for long-context workloads. However, exist…
cs.SE2026
W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases
Hridya Dhulipala, Rajesh Ombase, Michael Wang +1
Retrieval-Augmented Generation (RAG) enables large language models to incorporate external knowledge during generation, improving factual grounding and domain adaptability. However…