2 papers
cs.AI2026
EGG: An Expert-Guided Agent Framework for Kernel Generation
Yaochen Han, Ke Fan, Hongxu Jiang +5
High-performance GPU kernels are critical for reducing the exponentially growing computational costs of large language models (LLMs), but their development heavily relies on manual…
cs.CL2026
From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation
Jiahao Wang, Weiyu Xie, Mingxing Zhang +10
Retrieval-Augmented Generation enhances Large Language Models by integrating external knowledge, which reduces hallucinations but increases prompt length. This increase leads to hi…