2 papers
cs.LG2025
HA-RAG: Hotness-Aware RAG Acceleration via Mixed Precision and Data Placement
Danying Ge, Jianhua Gao, Yixue Yang +1
Retrieval-Augmented Generation (RAG) improves model output accuracy by leveraging external knowledge bases, serving as an effective solution to address hallucination issues and kno…
cs.CL2025
Automatic Task Detection and Heterogeneous LLM Speculative Decoding
Danying Ge, Jianhua Gao, Qizhi Jiang +2
Speculative decoding, which combines a draft model with a target model, has emerged as an effective approach to accelerate large language model (LLM) inference. However, existing m…