most citedAccelerating Retrieval-Augmented Language Model Serving with Speculation

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2024★ 1 cited

Accelerating Retrieval-Augmented Language Model Serving with Speculation

Zhihao Zhang, Alan Zhu, Lijie Yang +4

Retrieval-augmented language models (RaLM) have demonstrated the potential to solve knowledge-intensive natural language processing (NLP) tasks by combining a non-parametric knowle…