1 citations · 1 across the 7 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
TSS: Target-Side Sparsification for Speculative Decoding in Domain-Specific Large Language Models
Haibo Hu, Lianming Huang, Qiao Li +2
Speculative decoding accelerates large language model inference through collaboration between a lightweight draft model and a target verifier. Existing methods mainly improve the d…
cs.CL2024
Retrieval-Augmented Generation for Natural Language Processing: A Survey
Shangyu Wu, Ying Xiong, Yufei Cui +8
Large language models (LLMs) have achieved strong empirical performance in various fields, benefiting from their huge amount of parameters that store knowledge. However, LLMs still…
cs.CL2024★ 1 cited
RAEE: A Robust Retrieval-Augmented Early Exit Framework for Efficient Inference
Lianming Huang, Shangyu Wu, Yufei Cui +6
Deploying large language model inference remains challenging due to their high computational overhead. Early exit optimizes model inference by adaptively reducing the number of inf…