3 papers
cs.CL2025
Accelerating Mobile Language Model via Speculative Decoding and NPU-Coordinated Execution
Zhiyang Chen, Daliang Xu, Haiyang Shen +5
Performing Retrieval-Augmented Generation (RAG) directly on mobile devices is promising for data privacy and responsiveness but is hindered by the architectural constraints of mobi…
cs.SE2025
A First Look at Bugs in LLM Inference Engines
Mugeng Liu, Siqi Zhong, Weichen Bi +5
Large language model-specific inference engines (in short as \emph{LLM inference engines}) have become a fundamental component of modern AI infrastructure, enabling the deployment…
cs.AI2025
DRAGON: Domain-specific Robust Automatic Data Generation for RAG Optimization
Haiyang Shen, Hang Yan, Zhongshi Xing +6
Retrieval-augmented generation (RAG) can substantially enhance the performance of LLMs on knowledge-intensive tasks. Various RAG paradigms - including vanilla, planning-based, and…